-- Logs begin at Wed 2022-08-31 18:25:26 UTC, end at Wed 2022-08-31 19:59:50 UTC. -- Aug 31 19:06:50.613594 dv-cinder-852209-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 19:06:50.622900 dv-cinder-852209-9-smb devstack@keystone.service[81720]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 19:06:50 2022] *** Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: nodename: dv-cinder-852209-9-smb Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: machine: x86_64 Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: clock source: unix Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: pcre jit disabled Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: detected number of CPU cores: 4 Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: current working directory: / Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: detected binary path: /usr/bin/uwsgi-core Aug 31 19:06:50.624914 dv-cinder-852209-9-smb devstack@keystone.service[81720]: your processes number limit is 47680 Aug 31 19:06:50.625600 dv-cinder-852209-9-smb devstack@keystone.service[81720]: your memory page size is 4096 bytes Aug 31 19:06:50.625600 dv-cinder-852209-9-smb devstack@keystone.service[81720]: detected max file descriptor number: 2048 Aug 31 19:06:50.625600 dv-cinder-852209-9-smb devstack@keystone.service[81720]: lock engine: pthread robust mutexes Aug 31 19:06:50.625600 dv-cinder-852209-9-smb devstack@keystone.service[81720]: thunder lock: enabled Aug 31 19:06:50.625600 dv-cinder-852209-9-smb devstack@keystone.service[81720]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 19:06:50.625600 dv-cinder-852209-9-smb devstack@keystone.service[81720]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 19:06:50.664575 dv-cinder-852209-9-smb devstack@keystone.service[81720]: Python main interpreter initialized at 0x5588601ef9c0 Aug 31 19:06:50.664575 dv-cinder-852209-9-smb devstack@keystone.service[81720]: python threads support enabled Aug 31 19:06:50.664575 dv-cinder-852209-9-smb devstack@keystone.service[81720]: your server socket listen backlog is limited to 100 connections Aug 31 19:06:50.664575 dv-cinder-852209-9-smb devstack@keystone.service[81720]: your mercy for graceful operations on workers is 90 seconds Aug 31 19:06:50.664898 dv-cinder-852209-9-smb devstack@keystone.service[81720]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 19:06:50.665000 dv-cinder-852209-9-smb devstack@keystone.service[81720]: *** Operational MODE: preforking *** Aug 31 19:06:50.665272 dv-cinder-852209-9-smb devstack@keystone.service[81720]: *** uWSGI is running in multiple interpreter mode *** Aug 31 19:06:50.665272 dv-cinder-852209-9-smb devstack@keystone.service[81720]: spawned uWSGI master process (pid: 81720) Aug 31 19:06:50.665473 dv-cinder-852209-9-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 19:06:50.666343 dv-cinder-852209-9-smb devstack@keystone.service[81720]: spawned uWSGI worker 1 (pid: 81727, cores: 1) Aug 31 19:06:50.666343 dv-cinder-852209-9-smb devstack@keystone.service[81720]: spawned uWSGI worker 2 (pid: 81728, cores: 1) Aug 31 19:06:50.666509 dv-cinder-852209-9-smb devstack@keystone.service[81720]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 19:06:54.965605 dv-cinder-852209-9-smb devstack@keystone.service[81728]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:06:54.965605 dv-cinder-852209-9-smb devstack@keystone.service[81728]: from cryptography.utils import int_from_bytes Aug 31 19:06:54.966391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:06:54.966391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: from cryptography.utils import int_from_bytes Aug 31 19:06:54.966788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:06:54.966788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: from cryptography.utils import int_from_bytes Aug 31 19:06:54.966903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:06:54.966903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: from cryptography.utils import int_from_bytes Aug 31 19:06:55.015435 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:06:55.015628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:06:55.015793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] command line args: [] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:06:55.015978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:06:55.016073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:06:55.016175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:06:55.016262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ================================================================================ {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:06:55.016369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] command line args: [] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:06:55.016454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] admin_token = **** {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.016637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:06:55.016729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] config_dir = [] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.016807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ================================================================================ {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:06:55.016877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.017059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] config_source = [] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.017151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] admin_token = **** {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.017228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] debug = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.017310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] config_dir = [] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.017382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.017641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.017641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] config_source = [] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.017862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.017931 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] debug = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.017989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.018044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.018193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.018296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.018412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.018508 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.018624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] list_limit = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.018733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.018843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] log_config_append = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.018938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.019042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.019234 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] list_limit = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.019345 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] log_dir = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.019441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] log_config_append = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.019535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] log_file = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.019635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.019765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.019842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] log_dir = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.019965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020040 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] log_file = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020040 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.020967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.021090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.021166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.021288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.021415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.021501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.021578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.021742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.021826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.021909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.021986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.022236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.022328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.022413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.022494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.022620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.022696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.022849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.023073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.023153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.023274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] publish_errors = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.023471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.023594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.023700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.023785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] publish_errors = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.023875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.023995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.024116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.024226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.024347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.024440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.024576 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] standard_threads = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.024653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.024801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.024894 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] standard_threads = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] use_journal = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] use_json = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] use_stderr = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] use_syslog = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.025973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] use_journal = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.026124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] use_json = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.026197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.026265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] use_stderr = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.026367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.026444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] use_syslog = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.026603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.026689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:06:55.026857 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.026944 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.027090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.027172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.027336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.027419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.027570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.027652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.027812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.027893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.028044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.028122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.028288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.028363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.028523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.028606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.028769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.028846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.028995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.029070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.029239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.029322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.029468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.029552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.029734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.029819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.029969 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.030045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.030207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.030285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.030450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.030526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.030687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.030771 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.030932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.031051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.031164 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.031261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.031412 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.031534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.031681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.031754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.031881 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.031958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.032138 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.032221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.032369 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.032447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.032596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.032673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.032824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.032901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.033055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.033131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.033283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.033360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.033516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.033593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.033775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.033852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.034004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.034081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.034236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.034321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.034466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.034542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.034699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.034774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.034942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.035031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.035169 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.035246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.035400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.035502 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.035629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.035718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.035854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.035931 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.036081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.036160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.036306 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.036381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.036530 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.036597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.036754 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.036826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.036982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.037132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.037249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.037398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.037517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.037630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.037805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.037955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.038062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.038207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.038317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.038457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.038571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.038685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.038832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.038940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.039073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.039192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.039301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.039436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.039555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.039664 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.039800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.039908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.040016 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.040150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.040270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.040380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.040515 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.040625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.040732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.040868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.040986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.041095 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.041230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.041351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.041461 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.041593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.041725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.041803 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.041906 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.041991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.042063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.042133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.042201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.042312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.042379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.042500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.042617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.042732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.042846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.043074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.043196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.043310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.043425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.043538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.043661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.043785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.043901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.044016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.044130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.044243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.044399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.044526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.044655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.044778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.044894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.045010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.045126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.045241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.045364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.045480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.045595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.045736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.045854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.045968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.046096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.046213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.046328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.046450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.046566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.046680 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.046803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.046919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.047058 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.047177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.047299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.047421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.047546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.047668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.047783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.047898 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.048013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.048128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.048251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.048367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.048472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.048588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.048702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.048816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.048939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.049055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.049170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.049285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.049399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.049513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.049636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.049769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.049885 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.049999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.050114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.050231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.050358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.050475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.050590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.050705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.050819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.050934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.051060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.051183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.051306 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.051423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.051544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.051693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.051820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] auth.external = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.051820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.052078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.052078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.052359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.052478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] auth.external = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.052594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.052716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.053326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] auth.password = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.053326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] auth.token = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.053548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.053717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.053838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.053970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.054089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] auth.password = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.054204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.054319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] auth.token = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.054436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.054551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.054675 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.054793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.054908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.055024 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.055139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.055254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.055378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] credential.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.055497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.055612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.055727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.055843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.055958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.056081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.056198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] credential.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.056320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.056437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.056554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.056669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.056796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.056913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.057028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.057149 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.057266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.057391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.057586 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.057721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.057839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.057954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.058068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.058183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.058311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.058428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.058544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.058667 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.058784 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.058899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.059023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.059141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.059263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] federation.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.059380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.059502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.059625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.059751 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.059868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.059984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.060100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] federation.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.060219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.060341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.060466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.060583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.060698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.060815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.060930 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.061046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.061170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.061287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.061403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.061518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.061633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.061787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.061920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.062038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.062154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.062270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.062386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.062502 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.062626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.062744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.062861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.062976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.063100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.063218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.063342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.063459 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.063575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.063691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.063806 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.063932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.064049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.064165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.064281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.064396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.064518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.064644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.064761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.064761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.064980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.065095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.065218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.065342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.065452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.065566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.065739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.065739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.065960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.066078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.066196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.066312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.066428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.066544 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.066660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.066784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.066903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.066903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.067121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.067237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.067352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.067476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.067594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.067716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.067832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.067947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.068063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.069119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.069250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.069368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.069483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.069867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.069990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.070123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.070244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.070364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.070480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.070595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.070710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.070833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.070958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.071075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.071190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.071307 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.071422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.071546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.071546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.071764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.071920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.072036 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.072151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.072321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.072449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.072566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.072681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.072797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.072912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.073037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.073196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.073317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.073433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.073548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.073680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.073812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.073931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.074046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.074161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.074276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.074392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.074516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.074632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.074748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.074864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.074979 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.075094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.075217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.075334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.075465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.075642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.075795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.075914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.076039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.076156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.076272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.076386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.076503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.076618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.076741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.076858 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.076973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.077088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.077203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.077327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.077450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.077568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.077714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.077834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.077949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.078077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.078196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.078311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.078426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.078541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.078657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.078780 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.078897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.079013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.079128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.079243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.079357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.079480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.079598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.079713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.079828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.079943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.080058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.080181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.080302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.080418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.080534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.080649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.080764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.080887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.081020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.081137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.081252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.081367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.081482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.081702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.081823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.081974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.082092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.082207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.082322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.082483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.082603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.082719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.082842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.082959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.083074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.083198 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.083315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.083315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.083532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.083647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.083762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.083762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.083989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.084105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.084221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.084336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] resource.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.084451 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.084575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.084692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.084692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.084909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.085023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.085138 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.085265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.085382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.085498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] resource.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.085613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.085613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.085926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.086054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.086173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.086288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.086410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.086527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.086641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.086765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] role.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.086882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.086981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] role.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.087096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.087212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.087327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.087450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.087567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.087683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.087799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.087914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.088029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] role.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.088152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.088270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] role.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.088270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.088485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.088485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.088702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.088825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.088942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.089060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.089175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.089291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.089405 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.089529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.089645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.089776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.089892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.090007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.090136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.090255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.090375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.090375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.090599 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.090716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.090839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.090956 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.091071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.091188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.091303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.091418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.091542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.091542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.091759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.091875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.092026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.092146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.092272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.092389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.092505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.092620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.092734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.092849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.092972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.093090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.093205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.093322 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.093437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.093552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.093690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.093809 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.093925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.094041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.094156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.094271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.094403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.094521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.094636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.094751 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.094866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.094990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] token.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.095107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.095222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.095345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.095461 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.095576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.095700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.095817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.095932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.096047 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.096162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.096277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] token.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.096401 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.096518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.096633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.096748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.096863 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.096978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.097100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.097200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.097297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.097411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.097535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.097656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.097888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.098007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.098124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.098240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.098355 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.098472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.098596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.098722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.098851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.098968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.099084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.099200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.099315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.connection = **** {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.099431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.099556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.099673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.099788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.099904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.100029 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.100153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.100270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.100468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.100589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.100705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.connection = **** {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.100820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.100820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.101046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.101170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.101288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.101404 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.101520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.101636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.101781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.101909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.102027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.102184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.102300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.102414 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.102529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.102653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.102772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.102887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:06:55.103936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:06:55.103936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:06:55.129939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.130169 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.130331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.130417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.130566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.130793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.139157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.139865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.167149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.167377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.167688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.167923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.237850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.238031 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.291204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.291418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.291618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.291712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.445932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.446158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.446386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.446611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.446832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.447050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.450743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.450971 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.457290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.457290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.457290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.457290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.477444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.477592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.477719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.477799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.477915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.477997 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.478140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.478237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.478357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.478438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.478573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.478652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.478783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.478863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.489538 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.489957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.508992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.509165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.509251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.509327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.509430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.509515 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.509652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.509893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.509977 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.510109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.510192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.510323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81728) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.510408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81727) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:06:55.527143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.527345 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:06:55.527691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.527801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.527881 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:06:55.527953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:06:55.528153 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.528420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.528676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.528772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.528933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.529015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:06:55.529234 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.529500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.529799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.530065 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.539055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.539329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.539601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.539885 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.540060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.540345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.540619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.541071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.547347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.548048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.550291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.550580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.550864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.550986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.555704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.555807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.555885 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.556892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.577346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.578836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.579123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.582126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.583813 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.584628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.584913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.587148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.587435 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.591414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.591704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.591981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.592266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.592548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.595791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.596083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.596366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.596652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.596931 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.597238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.597529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.597835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.599067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.599349 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.603930 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.604218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.604499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.604804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.605088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.607237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.607529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.607821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.616057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.616998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.620355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.623545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.623661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.623845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.623931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.627755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.628155 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.630876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.631236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.631487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.634616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.634929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.635215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.635511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.635595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.635793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.636080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.638701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.641813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.642118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.642442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.650100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.650100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.650100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.652560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.652843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.653110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.653375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.659668 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.659955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.660221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.660354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.660492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.661918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.664022 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.664299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.667140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.667426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.667710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.667827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.667997 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.668299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.669481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.671043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.671320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.674032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.674277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.674567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.678775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.678775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.679774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.680061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.680348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.680634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.680916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.681198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.681485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.686419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.686704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.686987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.687269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.687553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.687832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.688120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.697369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.700246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.703225 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.703814 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.704793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.706305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.706592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.706847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.706942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.713133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.713133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.713133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.713437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.713694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.713805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.715416 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.718374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.718675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.718960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.719238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.720189 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.721660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.724544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.725380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.725685 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.725960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.727857 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.728150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.728430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.733920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.734206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.736133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.736213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81727) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.736213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.736213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.736213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.736527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.736701 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.736963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.737242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.737628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.737927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.738203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.738485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.738752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.739032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81727) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.741420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81728) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:06:55.741724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.742023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.742288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.742561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.742850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.743129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.743407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.743684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.743949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.744215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.744483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.744745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.745018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81728) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:06:55.774012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588601ef9c0 pid: 81727 (default app) Aug 31 19:06:55.777405 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a94dc-5610-4c23-b1f1-45d081a746aa None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:55.777717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a94dc-5610-4c23-b1f1-45d081a746aa None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:55.778000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a94dc-5610-4c23-b1f1-45d081a746aa None None] PATH_INFO: `/v3` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:55.779333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588601ef9c0 pid: 81728 (default app) Aug 31 19:06:55.782312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Wed Aug 31 19:06:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:03.380073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cd797-a3bc-4195-adf2-5bede344ac1a None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.380646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cd797-a3bc-4195-adf2-5bede344ac1a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.380646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cd797-a3bc-4195-adf2-5bede344ac1a None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.385434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:03.390664 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:03.391188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:03.391289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:03.461185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: INFO dbcounter [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] Registered counter for database keystone Aug 31 19:07:03.482583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG oslo_db.sqlalchemy.engines [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:07:03.489300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writer thread running {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:07:03.668545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG passlib.handlers.bcrypt [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81727) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 19:07:03.668853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG passlib.handlers.bcrypt [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81727) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 19:07:03.727189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:03.728776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:03.857787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 19:07:04.337845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cd797-a3bc-4195-adf2-5bede344ac1a None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.406937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: INFO dbcounter [None req-7e6cd797-a3bc-4195-adf2-5bede344ac1a None None] Registered counter for database keystone Aug 31 19:07:04.426062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG oslo_db.sqlalchemy.engines [None req-7e6cd797-a3bc-4195-adf2-5bede344ac1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:07:04.432567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writer thread running {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:07:04.552660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cd797-a3bc-4195-adf2-5bede344ac1a None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.557570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f438e9-ed40-415e-87d7-4019785f3075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.558220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f438e9-ed40-415e-87d7-4019785f3075 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.558498 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f438e9-ed40-415e-87d7-4019785f3075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.558774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f438e9-ed40-415e-87d7-4019785f3075 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.567007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f438e9-ed40-415e-87d7-4019785f3075 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:04.618959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: WARNING keystone.common.rbac_enforcer.enforcer [None req-20f438e9-ed40-415e-87d7-4019785f3075 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 19:07:04.619243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f438e9-ed40-415e-87d7-4019785f3075 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:04.628995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:07:04.635564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:04.650252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70efac-1b0d-4696-9a93-7607655452a5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:04.654683 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a555-ed6c-4c75-b509-3d8f36d756b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:04.655786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a555-ed6c-4c75-b509-3d8f36d756b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:04.656067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a555-ed6c-4c75-b509-3d8f36d756b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:04.656347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a555-ed6c-4c75-b509-3d8f36d756b7 admin admin] PATH_INFO: `/v3/projects/e050b6f9e66f4591994e7fdf0d98777d` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:04.657955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737a555-ed6c-4c75-b509-3d8f36d756b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=e050b6f9e66f4591994e7fdf0d98777d)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:04.710439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c737a555-ed6c-4c75-b509-3d8f36d756b7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 19:07:04.710786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737a555-ed6c-4c75-b509-3d8f36d756b7 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:04.715328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Aug 31 19:07:04 2022] GET /identity/v3/projects/e050b6f9e66f4591994e7fdf0d98777d => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:06.578353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edec46-207c-4fc1-85a4-6bc215a07a6b None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:06.578889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edec46-207c-4fc1-85a4-6bc215a07a6b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:06.578889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edec46-207c-4fc1-85a4-6bc215a07a6b None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:06.582961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:06.588885 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff45ee-3eaf-44b9-838b-94ca73d29438 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:06.589280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff45ee-3eaf-44b9-838b-94ca73d29438 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:06.589433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff45ee-3eaf-44b9-838b-94ca73d29438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:06.609181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-63ff45ee-3eaf-44b9-838b-94ca73d29438 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:06.610742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-63ff45ee-3eaf-44b9-838b-94ca73d29438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:06.618683 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 19:07:06.898413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edec46-207c-4fc1-85a4-6bc215a07a6b None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:06.910343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edec46-207c-4fc1-85a4-6bc215a07a6b None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:06.914496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7cf1c-ef16-4e19-b0b2-5ee3c0e6846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:06.915094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7cf1c-ef16-4e19-b0b2-5ee3c0e6846e admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:06.915377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7cf1c-ef16-4e19-b0b2-5ee3c0e6846e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:06.915650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7cf1c-ef16-4e19-b0b2-5ee3c0e6846e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:06.923514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7cf1c-ef16-4e19-b0b2-5ee3c0e6846e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:06.925327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7cf1c-ef16-4e19-b0b2-5ee3c0e6846e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:06.934652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Aug 31 19:07:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:07:06.940440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff45ee-3eaf-44b9-838b-94ca73d29438 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:06.950676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff45ee-3eaf-44b9-838b-94ca73d29438 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:06.955215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba082cc-74d4-442b-aad0-35b198537aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:06.955848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba082cc-74d4-442b-aad0-35b198537aac admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:06.956134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba082cc-74d4-442b-aad0-35b198537aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:06.956415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba082cc-74d4-442b-aad0-35b198537aac admin admin] PATH_INFO: `/v3/users/59bd1470a00849b4b09de0a61612c525` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:06.957803 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba082cc-74d4-442b-aad0-35b198537aac admin admin] RBAC: Authorizing `identity:get_user(user_id=59bd1470a00849b4b09de0a61612c525)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:06.959641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba082cc-74d4-442b-aad0-35b198537aac admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:06.961233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Aug 31 19:07:06 2022] GET /identity/v3/users/59bd1470a00849b4b09de0a61612c525 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:08.934574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603987e-747b-4613-9bb4-faf09d81f90e None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.935101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603987e-747b-4613-9bb4-faf09d81f90e None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.935199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603987e-747b-4613-9bb4-faf09d81f90e None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.936466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:08.941629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05a524-cdef-43fc-a26a-166fbd8ade00 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.942060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05a524-cdef-43fc-a26a-166fbd8ade00 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.942223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05a524-cdef-43fc-a26a-166fbd8ade00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.961486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-8a05a524-cdef-43fc-a26a-166fbd8ade00 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:08.962720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8a05a524-cdef-43fc-a26a-166fbd8ade00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:08.969248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b02e-def1-4268-bc3a-8c4b751ae403 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.969527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b02e-def1-4268-bc3a-8c4b751ae403 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.969832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b02e-def1-4268-bc3a-8c4b751ae403 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:08.971158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:08.976575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ebb43-44ce-4a07-bcd5-778c64a93239 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:08.976859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ebb43-44ce-4a07-bcd5-778c64a93239 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:08.977304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ebb43-44ce-4a07-bcd5-778c64a93239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.019594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG passlib.handlers.bcrypt [None req-ed1ebb43-44ce-4a07-bcd5-778c64a93239 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81728) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 19:07:09.019986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG passlib.handlers.bcrypt [None req-ed1ebb43-44ce-4a07-bcd5-778c64a93239 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81728) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 19:07:09.044364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:09.070394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ed1ebb43-44ce-4a07-bcd5-778c64a93239 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:09.071991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ed1ebb43-44ce-4a07-bcd5-778c64a93239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:09.169060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:09.312519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05a524-cdef-43fc-a26a-166fbd8ade00 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.337744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.419562 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05a524-cdef-43fc-a26a-166fbd8ade00 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.436453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ebb43-44ce-4a07-bcd5-778c64a93239 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.456461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2c938-1b5e-47e8-8f29-2031b9707556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.457106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2c938-1b5e-47e8-8f29-2031b9707556 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.457384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2c938-1b5e-47e8-8f29-2031b9707556 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.457661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2c938-1b5e-47e8-8f29-2031b9707556 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.469747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2c938-1b5e-47e8-8f29-2031b9707556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-cfa2c938-1b5e-47e8-8f29-2031b9707556 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:09.478711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:09.479660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:09.481300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:09.485741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2c938-1b5e-47e8-8f29-2031b9707556 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.551624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ebb43-44ce-4a07-bcd5-778c64a93239 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.554049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.570093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.588393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2c938-1b5e-47e8-8f29-2031b9707556 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.590946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0a260-443c-415a-ac00-1fc8bae934e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.594175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0a260-443c-415a-ac00-1fc8bae934e8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.594175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0a260-443c-415a-ac00-1fc8bae934e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.594175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0a260-443c-415a-ac00-1fc8bae934e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.622936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af737a-29a8-4f60-b5b5-c01110d0784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.623542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af737a-29a8-4f60-b5b5-c01110d0784e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.623804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af737a-29a8-4f60-b5b5-c01110d0784e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.624076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af737a-29a8-4f60-b5b5-c01110d0784e None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.624739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af737a-29a8-4f60-b5b5-c01110d0784e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:09.625041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af737a-29a8-4f60-b5b5-c01110d0784e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.626442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af737a-29a8-4f60-b5b5-c01110d0784e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.639334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:09.644949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af737a-29a8-4f60-b5b5-c01110d0784e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.660117 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0a260-443c-415a-ac00-1fc8bae934e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.661679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0a260-443c-415a-ac00-1fc8bae934e8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.743619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af737a-29a8-4f60-b5b5-c01110d0784e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.760237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:07:09.766114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0a260-443c-415a-ac00-1fc8bae934e8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.769594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.779732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3b6be-16d1-4d63-8090-ab48473a9c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.780369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3b6be-16d1-4d63-8090-ab48473a9c76 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.780652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3b6be-16d1-4d63-8090-ab48473a9c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.780925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3b6be-16d1-4d63-8090-ab48473a9c76 None admin] PATH_INFO: `/v3/users/59bd1470a00849b4b09de0a61612c525` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.782076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3b6be-16d1-4d63-8090-ab48473a9c76 None admin] RBAC: Authorizing `identity:get_user(user_id=59bd1470a00849b4b09de0a61612c525)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.783541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3b6be-16d1-4d63-8090-ab48473a9c76 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.785097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/users/59bd1470a00849b4b09de0a61612c525 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:09.790605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3b6be-16d1-4d63-8090-ab48473a9c76 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.805728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:09.868468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0a260-443c-415a-ac00-1fc8bae934e8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.895087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3b6be-16d1-4d63-8090-ab48473a9c76 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:09.902455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8420515-80a6-4ad2-8f82-d84a2f426060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.903310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8420515-80a6-4ad2-8f82-d84a2f426060 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.903597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8420515-80a6-4ad2-8f82-d84a2f426060 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.903873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8420515-80a6-4ad2-8f82-d84a2f426060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.922734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8420515-80a6-4ad2-8f82-d84a2f426060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.924215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8420515-80a6-4ad2-8f82-d84a2f426060 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.928561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf6c55-be1e-43ae-9dbe-fbf19ce0edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:09.929192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf6c55-be1e-43ae-9dbe-fbf19ce0edd6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:09.929468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf6c55-be1e-43ae-9dbe-fbf19ce0edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:09.929769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf6c55-be1e-43ae-9dbe-fbf19ce0edd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:09.930881 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf6c55-be1e-43ae-9dbe-fbf19ce0edd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:09.932314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf6c55-be1e-43ae-9dbe-fbf19ce0edd6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:09.933886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:09.939515 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf6c55-be1e-43ae-9dbe-fbf19ce0edd6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-e8420515-80a6-4ad2-8f82-d84a2f426060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:09.942922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:09.945011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:09.946272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:09.946272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:09.946272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:09.946272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:09.950527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8420515-80a6-4ad2-8f82-d84a2f426060 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:10.007217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:10.020556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:10.039188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf6c55-be1e-43ae-9dbe-fbf19ce0edd6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:10.051159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8420515-80a6-4ad2-8f82-d84a2f426060 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:10.074587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cf0f4-69d5-4083-8b8a-fb91a64f800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:10.075561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf0f4-69d5-4083-8b8a-fb91a64f800a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:10.075561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf0f4-69d5-4083-8b8a-fb91a64f800a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:10.075775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cf0f4-69d5-4083-8b8a-fb91a64f800a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:10.076514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cf0f4-69d5-4083-8b8a-fb91a64f800a None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.domain.id=default, user.id=59bd1470a00849b4b09de0a61612c525) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:10.076824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cf0f4-69d5-4083-8b8a-fb91a64f800a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:10.078314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cf0f4-69d5-4083-8b8a-fb91a64f800a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:10.086014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/role_assignments?user.id=59bd1470a00849b4b09de0a61612c525&scope.domain.id=default&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:10.086159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608cdce-52e1-4a77-9326-b1094ebc4594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:10.086700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608cdce-52e1-4a77-9326-b1094ebc4594 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:10.086980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608cdce-52e1-4a77-9326-b1094ebc4594 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:10.087252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608cdce-52e1-4a77-9326-b1094ebc4594 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:10.087917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608cdce-52e1-4a77-9326-b1094ebc4594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:10.088212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608cdce-52e1-4a77-9326-b1094ebc4594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:10.089612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608cdce-52e1-4a77-9326-b1094ebc4594 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:10.113152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:12.408856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f000fce-6650-4a89-8f36-669b73996d6d None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.409366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f000fce-6650-4a89-8f36-669b73996d6d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.409439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f000fce-6650-4a89-8f36-669b73996d6d None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.410755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:12.416781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cdfb1-a309-4282-8457-19390a047929 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.417700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cdfb1-a309-4282-8457-19390a047929 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.418193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cdfb1-a309-4282-8457-19390a047929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.446770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c92cdfb1-a309-4282-8457-19390a047929 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:12.448340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c92cdfb1-a309-4282-8457-19390a047929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:12.468054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de309011-1e38-41f8-b289-951617ac647c None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.468695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de309011-1e38-41f8-b289-951617ac647c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.469171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de309011-1e38-41f8-b289-951617ac647c None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.471027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 13/23] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:12.485795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba29f2c-9f25-43e2-a932-1c11f8e6531a None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.486392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba29f2c-9f25-43e2-a932-1c11f8e6531a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.486903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba29f2c-9f25-43e2-a932-1c11f8e6531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.515168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-3ba29f2c-9f25-43e2-a932-1c11f8e6531a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:12.516731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3ba29f2c-9f25-43e2-a932-1c11f8e6531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:12.561101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:12.562273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600f1fb-af5d-4e2e-87d3-0819c2ddfeae None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.562594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600f1fb-af5d-4e2e-87d3-0819c2ddfeae None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.562873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600f1fb-af5d-4e2e-87d3-0819c2ddfeae None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.565994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 12/25] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:12.571893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dc543-e9db-46e1-b5a9-6b35cdf07657 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:12.572450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dc543-e9db-46e1-b5a9-6b35cdf07657 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:12.572908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dc543-e9db-46e1-b5a9-6b35cdf07657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:12.614251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ba6dc543-e9db-46e1-b5a9-6b35cdf07657 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:12.618109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ba6dc543-e9db-46e1-b5a9-6b35cdf07657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:12.688086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 14/26] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:12.714625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:12.745744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:13.017396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba29f2c-9f25-43e2-a932-1c11f8e6531a None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.074953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d21a-dd64-419c-9ed4-0e581138c4c5 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.075595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d21a-dd64-419c-9ed4-0e581138c4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.076069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d21a-dd64-419c-9ed4-0e581138c4c5 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.078151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 14/28] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:13.082895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0301-f081-4d39-a205-c4b63b907f04 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.083432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0301-f081-4d39-a205-c4b63b907f04 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.084411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0301-f081-4d39-a205-c4b63b907f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.113394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-168a0301-f081-4d39-a205-c4b63b907f04 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:13.116066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-168a0301-f081-4d39-a205-c4b63b907f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:13.161004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:13.204141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba29f2c-9f25-43e2-a932-1c11f8e6531a None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.206950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:13.208255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a0301-f081-4d39-a205-c4b63b907f04 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.249941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe48717-94f3-48bc-8104-820c5d130b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.250587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe48717-94f3-48bc-8104-820c5d130b4e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.250870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe48717-94f3-48bc-8104-820c5d130b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.251146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe48717-94f3-48bc-8104-820c5d130b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.265519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe48717-94f3-48bc-8104-820c5d130b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:13.267638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe48717-94f3-48bc-8104-820c5d130b4e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-afe48717-94f3-48bc-8104-820c5d130b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:13.290008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:13.290884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:13.291644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:13.291644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:13.291644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:13.291644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 15/30] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:13.291906 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe48717-94f3-48bc-8104-820c5d130b4e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.349052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a0301-f081-4d39-a205-c4b63b907f04 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.362910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:13.417957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe48717-94f3-48bc-8104-820c5d130b4e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.420664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f336920-85be-41f9-9534-e335a2a45979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.421559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f336920-85be-41f9-9534-e335a2a45979 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.422098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f336920-85be-41f9-9534-e335a2a45979 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.422567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f336920-85be-41f9-9534-e335a2a45979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.449905 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:13.458362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f336920-85be-41f9-9534-e335a2a45979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-4f336920-85be-41f9-9534-e335a2a45979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:13.473342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:13.477099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:13.477862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:13.479663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c526a7-fa12-429e-843e-81999309fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.480333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c526a7-fa12-429e-843e-81999309fbc0 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.480619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c526a7-fa12-429e-843e-81999309fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.480893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c526a7-fa12-429e-843e-81999309fbc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.481082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 16/31] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:13.481759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c526a7-fa12-429e-843e-81999309fbc0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:13.482513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f336920-85be-41f9-9534-e335a2a45979 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.487518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c526a7-fa12-429e-843e-81999309fbc0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:13.624378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f336920-85be-41f9-9534-e335a2a45979 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.662303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f831b8-a9e9-4c2a-856a-93d38f8ca07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.662922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f831b8-a9e9-4c2a-856a-93d38f8ca07e None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.667021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f831b8-a9e9-4c2a-856a-93d38f8ca07e None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.667021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f831b8-a9e9-4c2a-856a-93d38f8ca07e None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.667021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f831b8-a9e9-4c2a-856a-93d38f8ca07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:13.667021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f831b8-a9e9-4c2a-856a-93d38f8ca07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:13.667021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f831b8-a9e9-4c2a-856a-93d38f8ca07e None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:13.679942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 17/32] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:13.680888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f831b8-a9e9-4c2a-856a-93d38f8ca07e None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.711214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:13.719029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 16/33] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 31 19:07:13 2022] POST /identity/v3/roles => generated 219 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:13.720170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c526a7-fa12-429e-843e-81999309fbc0 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.827777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f831b8-a9e9-4c2a-856a-93d38f8ca07e None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.863527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c526a7-fa12-429e-843e-81999309fbc0 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:13.909115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bf5c4-8182-47ba-a7dc-e0c12877f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.909684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bf5c4-8182-47ba-a7dc-e0c12877f438 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.909963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bf5c4-8182-47ba-a7dc-e0c12877f438 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.910234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bf5c4-8182-47ba-a7dc-e0c12877f438 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.910917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bf5c4-8182-47ba-a7dc-e0c12877f438 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:13.911218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bf5c4-8182-47ba-a7dc-e0c12877f438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:13.913171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bf5c4-8182-47ba-a7dc-e0c12877f438 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:13.942152 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84099aa-2959-4b39-a8e2-f2f8d136a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:13.943160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84099aa-2959-4b39-a8e2-f2f8d136a45d None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:13.943689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84099aa-2959-4b39-a8e2-f2f8d136a45d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:13.944188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84099aa-2959-4b39-a8e2-f2f8d136a45d None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:13.945328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84099aa-2959-4b39-a8e2-f2f8d136a45d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:13.945986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 18/34] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:13.946825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bf5c4-8182-47ba-a7dc-e0c12877f438 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:13.948008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84099aa-2959-4b39-a8e2-f2f8d136a45d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:14.017434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 17/35] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 31 19:07:13 2022] POST /identity/v3/roles => generated 225 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:14.019163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98119976-5f13-4e10-b022-7d0ccc3317ed None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.019661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98119976-5f13-4e10-b022-7d0ccc3317ed None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.020106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98119976-5f13-4e10-b022-7d0ccc3317ed None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.021793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:14.022894 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98119976-5f13-4e10-b022-7d0ccc3317ed None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:14.052261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:14.066855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bf5c4-8182-47ba-a7dc-e0c12877f438 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:14.080460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:14.107841 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e094b0-19e4-4e3d-96df-b033b1cc6024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:14.108480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e094b0-19e4-4e3d-96df-b033b1cc6024 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.108873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e094b0-19e4-4e3d-96df-b033b1cc6024 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.109044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e094b0-19e4-4e3d-96df-b033b1cc6024 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.110000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e094b0-19e4-4e3d-96df-b033b1cc6024 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:14.111540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e094b0-19e4-4e3d-96df-b033b1cc6024 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:14.150331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98119976-5f13-4e10-b022-7d0ccc3317ed None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:14.187036 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b25f43-5123-4934-a21a-3c47fc402e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:14.187684 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b25f43-5123-4934-a21a-3c47fc402e3b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.187972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b25f43-5123-4934-a21a-3c47fc402e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.188284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b25f43-5123-4934-a21a-3c47fc402e3b None admin] PATH_INFO: `/v3/users/59bd1470a00849b4b09de0a61612c525` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.189440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b25f43-5123-4934-a21a-3c47fc402e3b None admin] RBAC: Authorizing `identity:get_user(user_id=59bd1470a00849b4b09de0a61612c525)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:14.190967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b25f43-5123-4934-a21a-3c47fc402e3b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:14.192641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 19/37] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:14 2022] GET /identity/v3/users/59bd1470a00849b4b09de0a61612c525 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:14.193913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804bb5-ebca-4cdd-87d9-592b4b6acdb9 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.194201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804bb5-ebca-4cdd-87d9-592b4b6acdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.195828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12804bb5-ebca-4cdd-87d9-592b4b6acdb9 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.196019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 20/38] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:14.197156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02275813-3e79-4c89-98e1-33f162277337 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.197445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02275813-3e79-4c89-98e1-33f162277337 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.197748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02275813-3e79-4c89-98e1-33f162277337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.216759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-02275813-3e79-4c89-98e1-33f162277337 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:14.218348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-02275813-3e79-4c89-98e1-33f162277337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:14.288479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 21/39] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:14.289325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02275813-3e79-4c89-98e1-33f162277337 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:14.340592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:14.368196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 19/40] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:07:13 2022] POST /identity/v3/projects => generated 301 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:14.370975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05ae41-c479-4594-a5a8-2da080809ad4 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.371273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05ae41-c479-4594-a5a8-2da080809ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.371554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05ae41-c479-4594-a5a8-2da080809ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.392106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4e05ae41-c479-4594-a5a8-2da080809ad4 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:14.393765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4e05ae41-c479-4594-a5a8-2da080809ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:14.405926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02275813-3e79-4c89-98e1-33f162277337 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:14.449939 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029b8a-0fbf-4f2f-8f35-b7ae34dffdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:14.451435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029b8a-0fbf-4f2f-8f35-b7ae34dffdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.451963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029b8a-0fbf-4f2f-8f35-b7ae34dffdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.452440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029b8a-0fbf-4f2f-8f35-b7ae34dffdf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.454067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31029b8a-0fbf-4f2f-8f35-b7ae34dffdf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:14.455917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31029b8a-0fbf-4f2f-8f35-b7ae34dffdf5 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:14.457862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 22/41] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:14.464239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029b8a-0fbf-4f2f-8f35-b7ae34dffdf5 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:14.479457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 20/42] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:14.563796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05ae41-c479-4594-a5a8-2da080809ad4 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:14.586904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029b8a-0fbf-4f2f-8f35-b7ae34dffdf5 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:14.603296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:14.635447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717fa9-be30-4601-bab9-72c21c999c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:14.636516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717fa9-be30-4601-bab9-72c21c999c0e None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.637331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717fa9-be30-4601-bab9-72c21c999c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.638230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717fa9-be30-4601-bab9-72c21c999c0e None admin] PATH_INFO: `/v3/domains/default/users/59bd1470a00849b4b09de0a61612c525/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.641063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717fa9-be30-4601-bab9-72c21c999c0e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=59bd1470a00849b4b09de0a61612c525, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:14.642781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717fa9-be30-4601-bab9-72c21c999c0e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:14.648764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:14.679695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05ae41-c479-4594-a5a8-2da080809ad4 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:14.714380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e710-cbcb-46ce-ac0e-86d02446c34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:14.714914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e710-cbcb-46ce-ac0e-86d02446c34d None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:14.715228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e710-cbcb-46ce-ac0e-86d02446c34d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:14.715534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e710-cbcb-46ce-ac0e-86d02446c34d None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:14.716225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613e710-cbcb-46ce-ac0e-86d02446c34d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:14.717821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613e710-cbcb-46ce-ac0e-86d02446c34d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:14.759060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 23/43] 10.222.0.42 () {58 vars in 1361 bytes} [Wed Aug 31 19:07:14 2022] PUT /identity/v3/domains/default/users/59bd1470a00849b4b09de0a61612c525/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:07:14.759944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717fa9-be30-4601-bab9-72c21c999c0e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:14.846050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 21/44] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 31 19:07:14 2022] POST /identity/v3/roles => generated 223 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:14.991029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717fa9-be30-4601-bab9-72c21c999c0e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:15.027980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbe91f-b374-41ad-89de-bc53f00edf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:15.028984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbe91f-b374-41ad-89de-bc53f00edf35 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:15.029485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbe91f-b374-41ad-89de-bc53f00edf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:15.030009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbe91f-b374-41ad-89de-bc53f00edf35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:15.031400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbe91f-b374-41ad-89de-bc53f00edf35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:15.032894 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbe91f-b374-41ad-89de-bc53f00edf35 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:15.034721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 24/45] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:15.040158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e710-cbcb-46ce-ac0e-86d02446c34d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:15.147344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e710-cbcb-46ce-ac0e-86d02446c34d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:15.175847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:15.182045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286020da-bb0d-472b-ae3f-8e248cd9b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:15.182665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286020da-bb0d-472b-ae3f-8e248cd9b6b9 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:15.182984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286020da-bb0d-472b-ae3f-8e248cd9b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:15.183268 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286020da-bb0d-472b-ae3f-8e248cd9b6b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:15.190248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286020da-bb0d-472b-ae3f-8e248cd9b6b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:15.190248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286020da-bb0d-472b-ae3f-8e248cd9b6b9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:15.321241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 22/46] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:07:15 2022] POST /identity/v3/projects => generated 312 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:16.725436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dcebf-0d10-44d6-9d9a-184318870f90 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.725976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dcebf-0d10-44d6-9d9a-184318870f90 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.726081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dcebf-0d10-44d6-9d9a-184318870f90 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.727348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 25/47] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:16.732735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629283c-1a02-4923-92eb-ad2c1246d77b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:16.733173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629283c-1a02-4923-92eb-ad2c1246d77b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:16.733299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629283c-1a02-4923-92eb-ad2c1246d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:16.751582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3629283c-1a02-4923-92eb-ad2c1246d77b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:16.752762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3629283c-1a02-4923-92eb-ad2c1246d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:16.822853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 23/48] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:17.091771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dcebf-0d10-44d6-9d9a-184318870f90 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.135172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:17.195706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dcebf-0d10-44d6-9d9a-184318870f90 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.230703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171c3d1-6443-40e9-9e29-e77bd9c843cb None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.230916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8d6c6-f9fb-4e4a-a0ad-6299dcd92771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.231035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171c3d1-6443-40e9-9e29-e77bd9c843cb None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.231250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171c3d1-6443-40e9-9e29-e77bd9c843cb None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.231506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8d6c6-f9fb-4e4a-a0ad-6299dcd92771 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.231789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8d6c6-f9fb-4e4a-a0ad-6299dcd92771 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.232064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8d6c6-f9fb-4e4a-a0ad-6299dcd92771 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.232753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 24/49] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:17.237793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1590e87-c243-47eb-ba32-1e0016c812f3 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.238083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1590e87-c243-47eb-ba32-1e0016c812f3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.238362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1590e87-c243-47eb-ba32-1e0016c812f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.242824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8d6c6-f9fb-4e4a-a0ad-6299dcd92771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-66f8d6c6-f9fb-4e4a-a0ad-6299dcd92771 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:17.247895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:17.248982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:17.250000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 26/50] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:17.255088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8d6c6-f9fb-4e4a-a0ad-6299dcd92771 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.257406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a1590e87-c243-47eb-ba32-1e0016c812f3 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:17.258632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a1590e87-c243-47eb-ba32-1e0016c812f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:17.327314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 25/51] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:17.354454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:17.357358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8d6c6-f9fb-4e4a-a0ad-6299dcd92771 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.393451 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcb270-0f12-403b-8705-42f351ff9451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.394385 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb270-0f12-403b-8705-42f351ff9451 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.394837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb270-0f12-403b-8705-42f351ff9451 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.395332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb270-0f12-403b-8705-42f351ff9451 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.396196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcb270-0f12-403b-8705-42f351ff9451 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:17.397196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcb270-0f12-403b-8705-42f351ff9451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.398895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcb270-0f12-403b-8705-42f351ff9451 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.407971 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 27/52] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:17.414148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1590e87-c243-47eb-ba32-1e0016c812f3 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.463389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:17.522810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1590e87-c243-47eb-ba32-1e0016c812f3 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.560057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c4817-7ba5-42b8-9ff7-eba874402d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.560705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c4817-7ba5-42b8-9ff7-eba874402d42 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.560994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c4817-7ba5-42b8-9ff7-eba874402d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.561277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c4817-7ba5-42b8-9ff7-eba874402d42 None admin] PATH_INFO: `/v3/users/59bd1470a00849b4b09de0a61612c525` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.562701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c4817-7ba5-42b8-9ff7-eba874402d42 None admin] RBAC: Authorizing `identity:get_user(user_id=59bd1470a00849b4b09de0a61612c525)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.564168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c4817-7ba5-42b8-9ff7-eba874402d42 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.565805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/users/59bd1470a00849b4b09de0a61612c525 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:17.571732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcb270-0f12-403b-8705-42f351ff9451 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.601753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c4817-7ba5-42b8-9ff7-eba874402d42 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.685432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcb270-0f12-403b-8705-42f351ff9451 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.722823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43511b59-6fb7-4299-9a50-fc9467206342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.723458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43511b59-6fb7-4299-9a50-fc9467206342 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.723754 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43511b59-6fb7-4299-9a50-fc9467206342 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.724034 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43511b59-6fb7-4299-9a50-fc9467206342 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.725156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43511b59-6fb7-4299-9a50-fc9467206342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.726717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43511b59-6fb7-4299-9a50-fc9467206342 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.728299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 28/54] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:17.734132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43511b59-6fb7-4299-9a50-fc9467206342 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.764601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:17.812092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c4817-7ba5-42b8-9ff7-eba874402d42 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.824818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:17.840515 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43511b59-6fb7-4299-9a50-fc9467206342 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:17.849046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0bae7-63c2-4b96-b891-1bce547ef723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.849752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0bae7-63c2-4b96-b891-1bce547ef723 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.850285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0bae7-63c2-4b96-b891-1bce547ef723 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.850779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0bae7-63c2-4b96-b891-1bce547ef723 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.852209 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0bae7-63c2-4b96-b891-1bce547ef723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.853856 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0bae7-63c2-4b96-b891-1bce547ef723 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.855458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:17.861149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0bae7-63c2-4b96-b891-1bce547ef723 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:17.877957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4f6be-a9d9-4a8f-b4e4-38fe837cae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:17.878573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f6be-a9d9-4a8f-b4e4-38fe837cae7a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:17.878975 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f6be-a9d9-4a8f-b4e4-38fe837cae7a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:17.879256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f6be-a9d9-4a8f-b4e4-38fe837cae7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:17.879990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4f6be-a9d9-4a8f-b4e4-38fe837cae7a None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.domain.id=default, user.id=59bd1470a00849b4b09de0a61612c525) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:17.880300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4f6be-a9d9-4a8f-b4e4-38fe837cae7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:17.882293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4f6be-a9d9-4a8f-b4e4-38fe837cae7a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:17.888210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 29/56] 10.222.0.42 () {56 vars in 1322 bytes} [Wed Aug 31 19:07:17 2022] GET /identity/v3/role_assignments?user.id=59bd1470a00849b4b09de0a61612c525&scope.domain.id=default&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:17.975698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0bae7-63c2-4b96-b891-1bce547ef723 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:18.012027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800928fc-7c53-4519-8d3c-b296a2d604d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:18.012654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800928fc-7c53-4519-8d3c-b296a2d604d9 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:18.012939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800928fc-7c53-4519-8d3c-b296a2d604d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:18.013214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800928fc-7c53-4519-8d3c-b296a2d604d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:18.013922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800928fc-7c53-4519-8d3c-b296a2d604d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:18.015414 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800928fc-7c53-4519-8d3c-b296a2d604d9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:18.113712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 28/57] 10.222.0.42 () {60 vars in 1140 bytes} [Wed Aug 31 19:07:17 2022] POST /identity/v3/projects => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:07:20.018241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f9f62-0391-447d-9679-7405d48d3b14 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.018745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f9f62-0391-447d-9679-7405d48d3b14 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.018914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f9f62-0391-447d-9679-7405d48d3b14 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.020344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 30/58] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:20.026062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d33d-fb47-416c-8f1c-9b1078ea7171 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.026491 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d33d-fb47-416c-8f1c-9b1078ea7171 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.026630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d33d-fb47-416c-8f1c-9b1078ea7171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.044828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9404d33d-fb47-416c-8f1c-9b1078ea7171 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:20.046065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9404d33d-fb47-416c-8f1c-9b1078ea7171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:20.070078 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:20.113211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 29/59] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:20.388564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f9f62-0391-447d-9679-7405d48d3b14 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.482865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:20.490626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f9f62-0391-447d-9679-7405d48d3b14 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.523478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf5475-7f2f-4559-bdac-5900d1a527e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:20.524370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5475-7f2f-4559-bdac-5900d1a527e8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.524812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5475-7f2f-4559-bdac-5900d1a527e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.525144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5475-7f2f-4559-bdac-5900d1a527e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.526607 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf5475-7f2f-4559-bdac-5900d1a527e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:20.528070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf5475-7f2f-4559-bdac-5900d1a527e8 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:20.529629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 31/60] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:20.535212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d33d-fb47-416c-8f1c-9b1078ea7171 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:20.631517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d33d-fb47-416c-8f1c-9b1078ea7171 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:20.665425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a44d84-4808-4f9b-b487-c32bc041785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:20.665986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44d84-4808-4f9b-b487-c32bc041785f None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:20.666314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44d84-4808-4f9b-b487-c32bc041785f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:20.666553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44d84-4808-4f9b-b487-c32bc041785f None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:20.667200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a44d84-4808-4f9b-b487-c32bc041785f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:20.668647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a44d84-4808-4f9b-b487-c32bc041785f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:20.753163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 30/61] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:20 2022] POST /identity/v3/users => generated 275 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:23.741630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ccf37-8263-43e6-a0d0-9a31143823b3 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.742673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ccf37-8263-43e6-a0d0-9a31143823b3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.743163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ccf37-8263-43e6-a0d0-9a31143823b3 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.745051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 32/62] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:23.750134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b2171-87a2-4e89-9881-589c2fd9bec3 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.750567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b2171-87a2-4e89-9881-589c2fd9bec3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.750687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b2171-87a2-4e89-9881-589c2fd9bec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.775910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4f8b2171-87a2-4e89-9881-589c2fd9bec3 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:23.777457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4f8b2171-87a2-4e89-9881-589c2fd9bec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:23.795532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:23.891814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5968bb5-ded6-45a5-a3fc-953c7086f127 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.892449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5968bb5-ded6-45a5-a3fc-953c7086f127 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.892739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 31/63] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:23.893158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5968bb5-ded6-45a5-a3fc-953c7086f127 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.894746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 33/64] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:23.900943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bb5ee-2bfd-43c9-b892-4fa8484116e2 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:23.901243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bb5ee-2bfd-43c9-b892-4fa8484116e2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:23.901531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bb5ee-2bfd-43c9-b892-4fa8484116e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:23.929237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-8d2bb5ee-2bfd-43c9-b892-4fa8484116e2 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:23.930699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8d2bb5ee-2bfd-43c9-b892-4fa8484116e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:24.027158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 32/65] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:24.071999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e279bf-0d9f-4e5a-956a-8414dd959f77 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.072322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e279bf-0d9f-4e5a-956a-8414dd959f77 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.072572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e279bf-0d9f-4e5a-956a-8414dd959f77 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.074228 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 34/66] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:24.079982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb410-b6f6-4523-8a71-2c1053765fb2 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.080283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb410-b6f6-4523-8a71-2c1053765fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.080568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cb410-b6f6-4523-8a71-2c1053765fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.110540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-dc1cb410-b6f6-4523-8a71-2c1053765fb2 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:24.111815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-dc1cb410-b6f6-4523-8a71-2c1053765fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:24.201600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 33/67] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:24.242626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e279bf-0d9f-4e5a-956a-8414dd959f77 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:24.369725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e279bf-0d9f-4e5a-956a-8414dd959f77 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:24.409988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af2622-668b-4d74-8082-c0178eb894d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:24.410634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2622-668b-4d74-8082-c0178eb894d8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.410919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2622-668b-4d74-8082-c0178eb894d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.411200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af2622-668b-4d74-8082-c0178eb894d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.422753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af2622-668b-4d74-8082-c0178eb894d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-07af2622-668b-4d74-8082-c0178eb894d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:24.428523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:24.429356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:24.430161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 35/68] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:24.435964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cb410-b6f6-4523-8a71-2c1053765fb2 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:24.445707 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:24.496830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d104-151c-4f57-86d4-d8d4094e7161 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.497172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d104-151c-4f57-86d4-d8d4094e7161 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.497458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d104-151c-4f57-86d4-d8d4094e7161 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.499450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 36/69] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:24.505193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89738268-979b-4b44-8f11-6a139fde1c34 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.506268 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89738268-979b-4b44-8f11-6a139fde1c34 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.506725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89738268-979b-4b44-8f11-6a139fde1c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.529479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-89738268-979b-4b44-8f11-6a139fde1c34 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:24.531114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-89738268-979b-4b44-8f11-6a139fde1c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:24.551191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:24.562685 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cb410-b6f6-4523-8a71-2c1053765fb2 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:24.598627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce896b2-d0ee-4312-ae84-aad0e595363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:24.599269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce896b2-d0ee-4312-ae84-aad0e595363a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.599557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce896b2-d0ee-4312-ae84-aad0e595363a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.599835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce896b2-d0ee-4312-ae84-aad0e595363a None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.600554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce896b2-d0ee-4312-ae84-aad0e595363a None admin] RBAC: Adding query filter params (name=member) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:24.600861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce896b2-d0ee-4312-ae84-aad0e595363a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:24.602267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce896b2-d0ee-4312-ae84-aad0e595363a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:24.604466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 37/70] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:24.605304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89738268-979b-4b44-8f11-6a139fde1c34 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:24.612499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 34/71] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:24.617339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af131a-534d-49cb-898d-d23896ce2d39 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.617339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af131a-534d-49cb-898d-d23896ce2d39 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.617339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af131a-534d-49cb-898d-d23896ce2d39 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.617339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 35/72] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:24.617339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af131a-534d-49cb-898d-d23896ce2d39 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:24.695860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:24.723526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89738268-979b-4b44-8f11-6a139fde1c34 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:24.734981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af131a-534d-49cb-898d-d23896ce2d39 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:24.765074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aac70b-15b9-4794-b279-6248f2d60364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:24.766140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aac70b-15b9-4794-b279-6248f2d60364 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.766377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aac70b-15b9-4794-b279-6248f2d60364 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.766676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aac70b-15b9-4794-b279-6248f2d60364 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.769625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d03fca-2d87-44c9-b392-b623533d2cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:24.770304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d03fca-2d87-44c9-b392-b623533d2cdf None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.770618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d03fca-2d87-44c9-b392-b623533d2cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.770899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d03fca-2d87-44c9-b392-b623533d2cdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.772772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d03fca-2d87-44c9-b392-b623533d2cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:24.774333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d03fca-2d87-44c9-b392-b623533d2cdf None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:24.776076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:24.776840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d03fca-2d87-44c9-b392-b623533d2cdf None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:24.782654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aac70b-15b9-4794-b279-6248f2d60364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-03aac70b-15b9-4794-b279-6248f2d60364 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:24.788013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:24.788983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:24.789944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 38/74] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:24.791074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704ed9b-2366-47d0-a9e9-92fb5b016526 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.791074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704ed9b-2366-47d0-a9e9-92fb5b016526 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.791348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704ed9b-2366-47d0-a9e9-92fb5b016526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.813809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-d704ed9b-2366-47d0-a9e9-92fb5b016526 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:24.813809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d704ed9b-2366-47d0-a9e9-92fb5b016526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:24.826952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:24.889389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 39/75] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:24.889389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704ed9b-2366-47d0-a9e9-92fb5b016526 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:24.910174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d03fca-2d87-44c9-b392-b623533d2cdf None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:24.950675 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ea271-50f8-4909-b54a-54f9aa254d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:24.951227 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ea271-50f8-4909-b54a-54f9aa254d7b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:24.951508 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ea271-50f8-4909-b54a-54f9aa254d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:24.951782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ea271-50f8-4909-b54a-54f9aa254d7b None admin] PATH_INFO: `/v3/users/ee10149ebbe7496c866e705d002c15a9` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:24.955365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:24.968204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ea271-50f8-4909-b54a-54f9aa254d7b None admin] RBAC: Authorizing `identity:get_user(user_id=ee10149ebbe7496c866e705d002c15a9)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:24.979648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ea271-50f8-4909-b54a-54f9aa254d7b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:24.979648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 37/76] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:24 2022] GET /identity/v3/users/ee10149ebbe7496c866e705d002c15a9 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:24.979648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ea271-50f8-4909-b54a-54f9aa254d7b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:25.001677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704ed9b-2366-47d0-a9e9-92fb5b016526 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:25.036213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcde5f-e098-4e13-bb43-a15b609f469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:25.036862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcde5f-e098-4e13-bb43-a15b609f469c None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:25.037146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcde5f-e098-4e13-bb43-a15b609f469c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:25.037424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcde5f-e098-4e13-bb43-a15b609f469c None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:25.038111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcde5f-e098-4e13-bb43-a15b609f469c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:25.039573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcde5f-e098-4e13-bb43-a15b609f469c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:25.077718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ea271-50f8-4909-b54a-54f9aa254d7b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:25.110534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49808d-2d0d-4b28-ad6a-603fe9722822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:25.111198 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49808d-2d0d-4b28-ad6a-603fe9722822 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:25.111484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49808d-2d0d-4b28-ad6a-603fe9722822 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:25.111764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49808d-2d0d-4b28-ad6a-603fe9722822 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:25.112474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49808d-2d0d-4b28-ad6a-603fe9722822 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:25.112782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49808d-2d0d-4b28-ad6a-603fe9722822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:25.114273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49808d-2d0d-4b28-ad6a-603fe9722822 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:25.123444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 38/77] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:25.124141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49808d-2d0d-4b28-ad6a-603fe9722822 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:25.142400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:25.148404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 40/78] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:24 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:25.149315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcde5f-e098-4e13-bb43-a15b609f469c None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:25.188994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:25.245065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49808d-2d0d-4b28-ad6a-603fe9722822 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:25.267849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcde5f-e098-4e13-bb43-a15b609f469c None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:25.287417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110f0e1-bb9d-40be-b9b3-2fab46469973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:25.288008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110f0e1-bb9d-40be-b9b3-2fab46469973 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:25.288321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110f0e1-bb9d-40be-b9b3-2fab46469973 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:25.288606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110f0e1-bb9d-40be-b9b3-2fab46469973 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:25.303046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110f0e1-bb9d-40be-b9b3-2fab46469973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-6110f0e1-bb9d-40be-b9b3-2fab46469973 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:25.308651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:25.309475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:25.310350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 39/79] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:25.313072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110f0e1-bb9d-40be-b9b3-2fab46469973 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:25.320951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9ebb7-50c5-498f-8b6c-01f06309b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:25.322147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ebb7-50c5-498f-8b6c-01f06309b263 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:25.322147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ebb7-50c5-498f-8b6c-01f06309b263 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:25.322342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ebb7-50c5-498f-8b6c-01f06309b263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:25.413876 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:25.420824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9ebb7-50c5-498f-8b6c-01f06309b263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:25.423198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9ebb7-50c5-498f-8b6c-01f06309b263 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:25.447014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110f0e1-bb9d-40be-b9b3-2fab46469973 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:25.468833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:25.492344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926ae97-fd61-486c-9170-0fa0470ba2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:25.492989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ae97-fd61-486c-9170-0fa0470ba2dc None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:25.493281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ae97-fd61-486c-9170-0fa0470ba2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:25.493557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ae97-fd61-486c-9170-0fa0470ba2dc None admin] PATH_INFO: `/v3/users/59bd1470a00849b4b09de0a61612c525` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:25.494777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926ae97-fd61-486c-9170-0fa0470ba2dc None admin] RBAC: Authorizing `identity:get_user(user_id=59bd1470a00849b4b09de0a61612c525)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:25.496281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926ae97-fd61-486c-9170-0fa0470ba2dc None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:25.498916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 40/80] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:25 2022] GET /identity/v3/users/59bd1470a00849b4b09de0a61612c525 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:25.498916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926ae97-fd61-486c-9170-0fa0470ba2dc None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:25.552472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 41/81] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:25.552660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9ebb7-50c5-498f-8b6c-01f06309b263 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:25.634154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926ae97-fd61-486c-9170-0fa0470ba2dc None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:25.671107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff974f0-ad99-4fe4-9f0f-3d7f3fa18706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:25.671746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff974f0-ad99-4fe4-9f0f-3d7f3fa18706 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:25.672035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff974f0-ad99-4fe4-9f0f-3d7f3fa18706 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:25.672316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff974f0-ad99-4fe4-9f0f-3d7f3fa18706 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:25.681800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:25.683638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff974f0-ad99-4fe4-9f0f-3d7f3fa18706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:25.686970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9ebb7-50c5-498f-8b6c-01f06309b263 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-4ff974f0-ad99-4fe4-9f0f-3d7f3fa18706 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:25.689148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:25.690023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:25.690825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 41/82] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:25.691440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff974f0-ad99-4fe4-9f0f-3d7f3fa18706 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:25.731065 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a939fec-1551-487a-81e7-0e664b969699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:25.731686 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a939fec-1551-487a-81e7-0e664b969699 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:25.731975 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a939fec-1551-487a-81e7-0e664b969699 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:25.732255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a939fec-1551-487a-81e7-0e664b969699 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:25.732934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a939fec-1551-487a-81e7-0e664b969699 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:25.733246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a939fec-1551-487a-81e7-0e664b969699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:25.734684 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a939fec-1551-487a-81e7-0e664b969699 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:25.743674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 42/83] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:25.744290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a939fec-1551-487a-81e7-0e664b969699 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:25.766155 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:25.839084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff974f0-ad99-4fe4-9f0f-3d7f3fa18706 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:25.872140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a939fec-1551-487a-81e7-0e664b969699 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:25.888075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e50975-6eb8-44d6-bff5-253e52e0cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:25.889212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e50975-6eb8-44d6-bff5-253e52e0cdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:25.889640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e50975-6eb8-44d6-bff5-253e52e0cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:25.890324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e50975-6eb8-44d6-bff5-253e52e0cdc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:25.909231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec1d4a-b2e8-4af7-b51e-a871cd2e9fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:25.910085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec1d4a-b2e8-4af7-b51e-a871cd2e9fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:25.910456 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec1d4a-b2e8-4af7-b51e-a871cd2e9fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:25.910834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec1d4a-b2e8-4af7-b51e-a871cd2e9fd9 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:25.912780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec1d4a-b2e8-4af7-b51e-a871cd2e9fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:25.914435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec1d4a-b2e8-4af7-b51e-a871cd2e9fd9 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:25.916185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 43/84] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:25 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:25.917075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec1d4a-b2e8-4af7-b51e-a871cd2e9fd9 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:25.955150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:25.976434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e50975-6eb8-44d6-bff5-253e52e0cdc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:25.978807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e50975-6eb8-44d6-bff5-253e52e0cdc6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:26.037430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:26.117639 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec1d4a-b2e8-4af7-b51e-a871cd2e9fd9 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:26.125730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 42/85] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:26.126810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e50975-6eb8-44d6-bff5-253e52e0cdc6 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:26.166265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598381a-d3be-4cfe-9a56-5f4b23cf5fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:26.167154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598381a-d3be-4cfe-9a56-5f4b23cf5fda None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.167576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598381a-d3be-4cfe-9a56-5f4b23cf5fda None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.167986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598381a-d3be-4cfe-9a56-5f4b23cf5fda None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.168826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598381a-d3be-4cfe-9a56-5f4b23cf5fda None admin] RBAC: Adding query filter params (name=member) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:26.169267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598381a-d3be-4cfe-9a56-5f4b23cf5fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:26.171344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598381a-d3be-4cfe-9a56-5f4b23cf5fda None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:26.184351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 44/86] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:26.185820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598381a-d3be-4cfe-9a56-5f4b23cf5fda None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:26.246279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e50975-6eb8-44d6-bff5-253e52e0cdc6 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:26.290774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:26.294904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fca9f8-9c22-4dbd-9293-06ee891cd4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:26.296344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca9f8-9c22-4dbd-9293-06ee891cd4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.296771 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca9f8-9c22-4dbd-9293-06ee891cd4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.297379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca9f8-9c22-4dbd-9293-06ee891cd4b8 None admin] PATH_INFO: `/v3/users/ee10149ebbe7496c866e705d002c15a9` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.299247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fca9f8-9c22-4dbd-9293-06ee891cd4b8 None admin] RBAC: Authorizing `identity:get_user(user_id=ee10149ebbe7496c866e705d002c15a9)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:26.300925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598381a-d3be-4cfe-9a56-5f4b23cf5fda None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:26.301100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fca9f8-9c22-4dbd-9293-06ee891cd4b8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:26.306168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 43/87] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:26 2022] GET /identity/v3/users/ee10149ebbe7496c866e705d002c15a9 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:26.310773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fca9f8-9c22-4dbd-9293-06ee891cd4b8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:26.330216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:26.361195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b17ea-9002-484a-bbf0-b9813dfb1af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:26.363884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b17ea-9002-484a-bbf0-b9813dfb1af6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.363884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b17ea-9002-484a-bbf0-b9813dfb1af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.363884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b17ea-9002-484a-bbf0-b9813dfb1af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.363884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b17ea-9002-484a-bbf0-b9813dfb1af6 None admin] RBAC: Adding query filter params (role.id=d1bf17fdde744527bb5905634f0b1b2c, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137, user.id=ee10149ebbe7496c866e705d002c15a9) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:26.363884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b17ea-9002-484a-bbf0-b9813dfb1af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:26.365471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b17ea-9002-484a-bbf0-b9813dfb1af6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:26.376584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 45/88] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:26 2022] GET /identity/v3/role_assignments?user.id=ee10149ebbe7496c866e705d002c15a9&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:26.377984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b17ea-9002-484a-bbf0-b9813dfb1af6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:26.453584 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fca9f8-9c22-4dbd-9293-06ee891cd4b8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:26.492522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35858e46-dc37-4a08-9296-04439d1c0b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:26.493030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35858e46-dc37-4a08-9296-04439d1c0b71 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.493311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35858e46-dc37-4a08-9296-04439d1c0b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.493639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35858e46-dc37-4a08-9296-04439d1c0b71 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.494900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35858e46-dc37-4a08-9296-04439d1c0b71 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:26.496360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35858e46-dc37-4a08-9296-04439d1c0b71 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:26.506223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 44/89] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:26 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:26.506223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35858e46-dc37-4a08-9296-04439d1c0b71 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:26.511119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b17ea-9002-484a-bbf0-b9813dfb1af6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:26.591119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649feb4-0719-43c8-87c7-054718d6e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:26.591865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649feb4-0719-43c8-87c7-054718d6e429 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.592195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649feb4-0719-43c8-87c7-054718d6e429 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.592477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649feb4-0719-43c8-87c7-054718d6e429 None admin] PATH_INFO: `/v3/users/ee10149ebbe7496c866e705d002c15a9` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.593639 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649feb4-0719-43c8-87c7-054718d6e429 None admin] RBAC: Authorizing `identity:get_user(user_id=ee10149ebbe7496c866e705d002c15a9)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:26.595125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649feb4-0719-43c8-87c7-054718d6e429 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:26.597572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 46/90] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:26 2022] GET /identity/v3/users/ee10149ebbe7496c866e705d002c15a9 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:26.598514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649feb4-0719-43c8-87c7-054718d6e429 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:26.645481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:26.657652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:26.688311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35858e46-dc37-4a08-9296-04439d1c0b71 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:26.722991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700cf27-a0e1-4a9b-804e-c3674c8cc3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:26.723939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700cf27-a0e1-4a9b-804e-c3674c8cc3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.724845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700cf27-a0e1-4a9b-804e-c3674c8cc3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.725225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700cf27-a0e1-4a9b-804e-c3674c8cc3f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.807619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700cf27-a0e1-4a9b-804e-c3674c8cc3f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:26.809793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700cf27-a0e1-4a9b-804e-c3674c8cc3f4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:26.837952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649feb4-0719-43c8-87c7-054718d6e429 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:26.903270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:26.912110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4cd99-6e0e-4067-879d-c1c0d02cb20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:26.913413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4cd99-6e0e-4067-879d-c1c0d02cb20d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:26.923674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4cd99-6e0e-4067-879d-c1c0d02cb20d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:26.923674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4cd99-6e0e-4067-879d-c1c0d02cb20d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:26.923674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4cd99-6e0e-4067-879d-c1c0d02cb20d None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137, user.id=59bd1470a00849b4b09de0a61612c525) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:26.923674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4cd99-6e0e-4067-879d-c1c0d02cb20d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:26.923674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4cd99-6e0e-4067-879d-c1c0d02cb20d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:26.926977 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 45/91] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:26.928740 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700cf27-a0e1-4a9b-804e-c3674c8cc3f4 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:26.931508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 47/92] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:26 2022] GET /identity/v3/role_assignments?user.id=59bd1470a00849b4b09de0a61612c525&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:26.939211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4cd99-6e0e-4067-879d-c1c0d02cb20d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:27.060295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700cf27-a0e1-4a9b-804e-c3674c8cc3f4 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:27.073833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:27.096351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4cd99-6e0e-4067-879d-c1c0d02cb20d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:27.104963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f3ef5-1530-4ee5-b246-c716efdda9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:27.105927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f3ef5-1530-4ee5-b246-c716efdda9ed None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.106556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f3ef5-1530-4ee5-b246-c716efdda9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.106976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f3ef5-1530-4ee5-b246-c716efdda9ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.147594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb6cb-d728-4316-9869-42bda64dfb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:27.148679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb6cb-d728-4316-9869-42bda64dfb45 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.149064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb6cb-d728-4316-9869-42bda64dfb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.149448 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb6cb-d728-4316-9869-42bda64dfb45 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.151011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bb6cb-d728-4316-9869-42bda64dfb45 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:27.153611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bb6cb-d728-4316-9869-42bda64dfb45 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:27.155438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 48/93] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:26 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:27.162963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb6cb-d728-4316-9869-42bda64dfb45 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:27.175841 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:27.199058 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f3ef5-1530-4ee5-b246-c716efdda9ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:27.200881 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f3ef5-1530-4ee5-b246-c716efdda9ed None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:27.294960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb6cb-d728-4316-9869-42bda64dfb45 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:27.359286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde6859-445c-496d-b36d-ddf940602673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:27.359912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6859-445c-496d-b36d-ddf940602673 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.360198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6859-445c-496d-b36d-ddf940602673 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.360485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6859-445c-496d-b36d-ddf940602673 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.361233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde6859-445c-496d-b36d-ddf940602673 None admin] RBAC: Adding query filter params (role.id=3ba2e6e2ec814831bb3bc254484024d2, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137, user.id=ee10149ebbe7496c866e705d002c15a9) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:27.361548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde6859-445c-496d-b36d-ddf940602673 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:27.363256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde6859-445c-496d-b36d-ddf940602673 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:27.370787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 49/94] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:27 2022] GET /identity/v3/role_assignments?user.id=ee10149ebbe7496c866e705d002c15a9&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=3ba2e6e2ec814831bb3bc254484024d2 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:27.423466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 46/95] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:27.429508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde6859-445c-496d-b36d-ddf940602673 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:27.463648 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:27.577965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde6859-445c-496d-b36d-ddf940602673 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:27.589712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b392f-bda0-4091-a362-6e93dcb8f60d None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.590372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b392f-bda0-4091-a362-6e93dcb8f60d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.590921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b392f-bda0-4091-a362-6e93dcb8f60d None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.592690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 47/96] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:27.603251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e83ca-0a2b-4af7-bb67-2c4edc6ce41b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.603969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e83ca-0a2b-4af7-bb67-2c4edc6ce41b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.604463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e83ca-0a2b-4af7-bb67-2c4edc6ce41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.616260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed93f5-5c6b-4dd4-ac05-7366c89bfffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:27.616936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed93f5-5c6b-4dd4-ac05-7366c89bfffc None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.617244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed93f5-5c6b-4dd4-ac05-7366c89bfffc None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.617530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed93f5-5c6b-4dd4-ac05-7366c89bfffc None admin] PATH_INFO: `/v3/projects/5784fee7e75c4c8baeb5cee82b8dd96d` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.618866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed93f5-5c6b-4dd4-ac05-7366c89bfffc None admin] RBAC: Authorizing `identity:get_project(project_id=5784fee7e75c4c8baeb5cee82b8dd96d)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:27.620742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed93f5-5c6b-4dd4-ac05-7366c89bfffc None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:27.623658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 50/97] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:27 2022] GET /identity/v3/projects/5784fee7e75c4c8baeb5cee82b8dd96d => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:27.625098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9871c-416e-469a-bfaf-3ab0ba0090a3 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.625389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9871c-416e-469a-bfaf-3ab0ba0090a3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.625691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9871c-416e-469a-bfaf-3ab0ba0090a3 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.627058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 51/98] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:27.630362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9871c-416e-469a-bfaf-3ab0ba0090a3 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:27.637598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a62e83ca-0a2b-4af7-bb67-2c4edc6ce41b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:27.639292 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a62e83ca-0a2b-4af7-bb67-2c4edc6ce41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:27.738133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 48/99] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:27.741033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3fb6c-f24c-4e2f-920d-a89adb1b934d None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.741530 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3fb6c-f24c-4e2f-920d-a89adb1b934d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.742109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3fb6c-f24c-4e2f-920d-a89adb1b934d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.762555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e7d3fb6c-f24c-4e2f-920d-a89adb1b934d None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:27.764403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e7d3fb6c-f24c-4e2f-920d-a89adb1b934d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:27.768708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:27.798848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:27.839019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9871c-416e-469a-bfaf-3ab0ba0090a3 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:27.846258 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 49/100] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:27.893227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fee624-b469-4a48-8df0-9b80089b19fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:27.893878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fee624-b469-4a48-8df0-9b80089b19fd None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:27.894165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fee624-b469-4a48-8df0-9b80089b19fd None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:27.894444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fee624-b469-4a48-8df0-9b80089b19fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:27.895218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fee624-b469-4a48-8df0-9b80089b19fd None admin] RBAC: Adding query filter params (role.id=d1bf17fdde744527bb5905634f0b1b2c, scope.project.id=5784fee7e75c4c8baeb5cee82b8dd96d, user.id=ee10149ebbe7496c866e705d002c15a9) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:27.895535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fee624-b469-4a48-8df0-9b80089b19fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:27.897545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fee624-b469-4a48-8df0-9b80089b19fd None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:27.903587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 52/101] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:27 2022] GET /identity/v3/role_assignments?user.id=ee10149ebbe7496c866e705d002c15a9&scope.project.id=5784fee7e75c4c8baeb5cee82b8dd96d&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:28.295785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3fb6c-f24c-4e2f-920d-a89adb1b934d None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.360102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fee624-b469-4a48-8df0-9b80089b19fd None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.445809 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3fb6c-f24c-4e2f-920d-a89adb1b934d None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.520454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f033b8b-5f79-418f-83f7-10f794126a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.521657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033b8b-5f79-418f-83f7-10f794126a8c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.521964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033b8b-5f79-418f-83f7-10f794126a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.522242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f033b8b-5f79-418f-83f7-10f794126a8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.538985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fee624-b469-4a48-8df0-9b80089b19fd None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.541797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:28.546817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f033b8b-5f79-418f-83f7-10f794126a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-9f033b8b-5f79-418f-83f7-10f794126a8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:28.554623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:28.555526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:28.556270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 50/102] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:28.559219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f033b8b-5f79-418f-83f7-10f794126a8c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.619910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f3f1e-a407-4933-8fe8-e316ec8563d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.620846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f3f1e-a407-4933-8fe8-e316ec8563d1 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.621411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f3f1e-a407-4933-8fe8-e316ec8563d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.621858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f3f1e-a407-4933-8fe8-e316ec8563d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.626367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f3f1e-a407-4933-8fe8-e316ec8563d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:28.628035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f3f1e-a407-4933-8fe8-e316ec8563d1 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:28.629845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 53/103] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:28.635570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f3f1e-a407-4933-8fe8-e316ec8563d1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.657350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:28.747605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f3f1e-a407-4933-8fe8-e316ec8563d1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.783717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c5bc5-4898-4b7e-9007-d27448d81a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.784714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c5bc5-4898-4b7e-9007-d27448d81a08 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.785146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c5bc5-4898-4b7e-9007-d27448d81a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.789699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c5bc5-4898-4b7e-9007-d27448d81a08 None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.789699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c5bc5-4898-4b7e-9007-d27448d81a08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:28.789699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c5bc5-4898-4b7e-9007-d27448d81a08 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:28.820528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f033b8b-5f79-418f-83f7-10f794126a8c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:28.881361 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a1451-e290-4a3b-8f8d-899545f497fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:28.882090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1451-e290-4a3b-8f8d-899545f497fd None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:28.882383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1451-e290-4a3b-8f8d-899545f497fd None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:28.882689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1451-e290-4a3b-8f8d-899545f497fd None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:28.883445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a1451-e290-4a3b-8f8d-899545f497fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:28.883756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a1451-e290-4a3b-8f8d-899545f497fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:28.885180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a1451-e290-4a3b-8f8d-899545f497fd None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:28.899059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 51/104] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:28.904671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a1451-e290-4a3b-8f8d-899545f497fd None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:28.943527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 54/105] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:07:28 2022] POST /identity/v3/projects => generated 302 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:28.974619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:29.018233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a1451-e290-4a3b-8f8d-899545f497fd None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:29.111607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee2238-cb00-4ba5-b397-a1fbf9d96fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:29.112263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2238-cb00-4ba5-b397-a1fbf9d96fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.112476 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ad49-2ba4-45a7-ac9b-a13dd175052c None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.112590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2238-cb00-4ba5-b397-a1fbf9d96fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.112768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ad49-2ba4-45a7-ac9b-a13dd175052c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.112864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2238-cb00-4ba5-b397-a1fbf9d96fd3 None admin] PATH_INFO: `/v3/users/5ae743ef64a045fbac2769c65d03ab8a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.113058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8ad49-2ba4-45a7-ac9b-a13dd175052c None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.114582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 55/106] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:29.120221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07bfca-15da-4acc-9c44-22f87a7d92ed None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.120822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07bfca-15da-4acc-9c44-22f87a7d92ed None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.121311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07bfca-15da-4acc-9c44-22f87a7d92ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.132217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee2238-cb00-4ba5-b397-a1fbf9d96fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=5ae743ef64a045fbac2769c65d03ab8a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:29.133741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee2238-cb00-4ba5-b397-a1fbf9d96fd3 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:29.135547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 52/107] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:28 2022] GET /identity/v3/users/5ae743ef64a045fbac2769c65d03ab8a => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:29.141147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee2238-cb00-4ba5-b397-a1fbf9d96fd3 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:29.144630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9f07bfca-15da-4acc-9c44-22f87a7d92ed None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:29.146707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9f07bfca-15da-4acc-9c44-22f87a7d92ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:29.248645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:29.260087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 56/108] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:29.304308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee2238-cb00-4ba5-b397-a1fbf9d96fd3 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:29.334095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:29.359730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413d68-36fd-4c1e-9d35-ea712402534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:29.360791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413d68-36fd-4c1e-9d35-ea712402534f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.360791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413d68-36fd-4c1e-9d35-ea712402534f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.360969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413d68-36fd-4c1e-9d35-ea712402534f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.454752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8413d68-36fd-4c1e-9d35-ea712402534f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:29.456254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8413d68-36fd-4c1e-9d35-ea712402534f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:29.580174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 53/109] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:07:29.586160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07bfca-15da-4acc-9c44-22f87a7d92ed None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:29.682353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413d68-36fd-4c1e-9d35-ea712402534f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:29.733616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:29.748614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07bfca-15da-4acc-9c44-22f87a7d92ed None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:29.799433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4098e91-45ec-4860-b703-09b0f8892c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:29.800466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4098e91-45ec-4860-b703-09b0f8892c96 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.800940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4098e91-45ec-4860-b703-09b0f8892c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.801423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4098e91-45ec-4860-b703-09b0f8892c96 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.803345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4098e91-45ec-4860-b703-09b0f8892c96 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:29.805009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4098e91-45ec-4860-b703-09b0f8892c96 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:29.806932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 57/110] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:29 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:29.808342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ecaa3-8e4e-4db3-aa1a-4d31fef1fbd2 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.813807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ecaa3-8e4e-4db3-aa1a-4d31fef1fbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.814336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ecaa3-8e4e-4db3-aa1a-4d31fef1fbd2 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.815910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 58/111] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:29.816859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ecaa3-8e4e-4db3-aa1a-4d31fef1fbd2 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:29.841259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413d68-36fd-4c1e-9d35-ea712402534f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:29.888193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260a9cb-7c44-4b1b-a8ce-724c4b5c1263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:29.888993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260a9cb-7c44-4b1b-a8ce-724c4b5c1263 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.889285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260a9cb-7c44-4b1b-a8ce-724c4b5c1263 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.889565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260a9cb-7c44-4b1b-a8ce-724c4b5c1263 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.893538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:29.909412 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260a9cb-7c44-4b1b-a8ce-724c4b5c1263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-b260a9cb-7c44-4b1b-a8ce-724c4b5c1263 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:29.918487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:29.919364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:29.920555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 54/112] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:29.921207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436973-376e-41c2-b479-3dcd2b74d603 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.921207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436973-376e-41c2-b479-3dcd2b74d603 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.921572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436973-376e-41c2-b479-3dcd2b74d603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.935156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ecaa3-8e4e-4db3-aa1a-4d31fef1fbd2 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:29.971866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d769-9984-4da6-afd2-74d856923fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:29.984346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d769-9984-4da6-afd2-74d856923fcc None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:29.984346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d769-9984-4da6-afd2-74d856923fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:29.984346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d769-9984-4da6-afd2-74d856923fcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:29.984346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6d769-9984-4da6-afd2-74d856923fcc None admin] RBAC: Adding query filter params (role.id=d2ed58a85e7941fcadc0916d8c31fdb2, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137, user.id=5ae743ef64a045fbac2769c65d03ab8a) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:29.984346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6d769-9984-4da6-afd2-74d856923fcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:29.984346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6d769-9984-4da6-afd2-74d856923fcc None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:29.985300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 59/113] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:29 2022] GET /identity/v3/role_assignments?user.id=5ae743ef64a045fbac2769c65d03ab8a&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=d2ed58a85e7941fcadc0916d8c31fdb2 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:29.985300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d769-9984-4da6-afd2-74d856923fcc None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:29.985581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a1436973-376e-41c2-b479-3dcd2b74d603 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:29.985581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a1436973-376e-41c2-b479-3dcd2b74d603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:30.189092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 55/114] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:30.216506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d769-9984-4da6-afd2-74d856923fcc None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.259741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f98e01-3462-4a52-ac5f-f8442e469db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.260287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f98e01-3462-4a52-ac5f-f8442e469db8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.260617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f98e01-3462-4a52-ac5f-f8442e469db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.260896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f98e01-3462-4a52-ac5f-f8442e469db8 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.261576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f98e01-3462-4a52-ac5f-f8442e469db8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:30.261948 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f98e01-3462-4a52-ac5f-f8442e469db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.263746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f98e01-3462-4a52-ac5f-f8442e469db8 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:30.270110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.273824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 60/115] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:30.280819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1436973-376e-41c2-b479-3dcd2b74d603 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.300322 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.411204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1436973-376e-41c2-b479-3dcd2b74d603 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.454552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30ad9f-b815-425f-828b-3c860778f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.455209 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ad9f-b815-425f-828b-3c860778f426 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.455503 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ad9f-b815-425f-828b-3c860778f426 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.455783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ad9f-b815-425f-828b-3c860778f426 None admin] PATH_INFO: `/v3/users/ee10149ebbe7496c866e705d002c15a9` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.456925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30ad9f-b815-425f-828b-3c860778f426 None admin] RBAC: Authorizing `identity:get_user(user_id=ee10149ebbe7496c866e705d002c15a9)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.458433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30ad9f-b815-425f-828b-3c860778f426 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:30.460649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 56/116] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/users/ee10149ebbe7496c866e705d002c15a9 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:30.466264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f98e01-3462-4a52-ac5f-f8442e469db8 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.481712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ce3f7-780f-4f84-9570-5a6c4afd64d1 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.482150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ce3f7-780f-4f84-9570-5a6c4afd64d1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.482434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ce3f7-780f-4f84-9570-5a6c4afd64d1 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.484050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 57/117] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:30.489222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d554662-f176-44a0-994d-e58cebccb6a5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.489495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d554662-f176-44a0-994d-e58cebccb6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.490416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d554662-f176-44a0-994d-e58cebccb6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.518188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-6d554662-f176-44a0-994d-e58cebccb6a5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:30.520001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6d554662-f176-44a0-994d-e58cebccb6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:30.607673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 58/118] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:30.655651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d554662-f176-44a0-994d-e58cebccb6a5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.676267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f98e01-3462-4a52-ac5f-f8442e469db8 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.676774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.759327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee4db-0602-4066-a823-441b5002b452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.759987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee4db-0602-4066-a823-441b5002b452 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.760277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee4db-0602-4066-a823-441b5002b452 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.760558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee4db-0602-4066-a823-441b5002b452 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.761850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fee4db-0602-4066-a823-441b5002b452 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.763241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fee4db-0602-4066-a823-441b5002b452 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:30.764891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 61/119] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:30.773160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee4db-0602-4066-a823-441b5002b452 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.851526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d554662-f176-44a0-994d-e58cebccb6a5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.862636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:30.904530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee4db-0602-4066-a823-441b5002b452 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:30.912745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096e56a-ffed-4f55-b9f3-01469f8a5081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.913441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096e56a-ffed-4f55-b9f3-01469f8a5081 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.913754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096e56a-ffed-4f55-b9f3-01469f8a5081 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.914039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096e56a-ffed-4f55-b9f3-01469f8a5081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.928032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096e56a-ffed-4f55-b9f3-01469f8a5081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-8096e56a-ffed-4f55-b9f3-01469f8a5081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:30.941208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:30.942118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:30.943513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 59/120] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:30.944653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea48d7-09a5-4870-bd8c-06d2020b8933 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.945195 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea48d7-09a5-4870-bd8c-06d2020b8933 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.945484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea48d7-09a5-4870-bd8c-06d2020b8933 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.946751 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 60/121] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:30.949214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea48d7-09a5-4870-bd8c-06d2020b8933 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:30.983069 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e17f8-37d0-4661-9126-305f4d167d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:30.983870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e17f8-37d0-4661-9126-305f4d167d0c None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:30.984158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e17f8-37d0-4661-9126-305f4d167d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:30.984760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e17f8-37d0-4661-9126-305f4d167d0c None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/users/ee10149ebbe7496c866e705d002c15a9/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:30.988918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e17f8-37d0-4661-9126-305f4d167d0c None admin] RBAC: Authorizing `identity:create_grant(project_id=f4bff8a4031648c7b2f2ebfdb69f7137, user_id=ee10149ebbe7496c866e705d002c15a9, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:30.992437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e17f8-37d0-4661-9126-305f4d167d0c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.069191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 62/122] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:30 2022] PUT /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/users/ee10149ebbe7496c866e705d002c15a9/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:31.071182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57425ab5-0a24-4c0c-affc-49976d616a43 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.071802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57425ab5-0a24-4c0c-affc-49976d616a43 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.072281 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57425ab5-0a24-4c0c-affc-49976d616a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.090383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.098687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-57425ab5-0a24-4c0c-affc-49976d616a43 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:31.100403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-57425ab5-0a24-4c0c-affc-49976d616a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:31.165243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea48d7-09a5-4870-bd8c-06d2020b8933 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.209434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafb69e-05ae-4fb7-9b4f-e7987377e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.212292 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafb69e-05ae-4fb7-9b4f-e7987377e055 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.213734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafb69e-05ae-4fb7-9b4f-e7987377e055 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.214926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafb69e-05ae-4fb7-9b4f-e7987377e055 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.217296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafb69e-05ae-4fb7-9b4f-e7987377e055 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:31.218587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafb69e-05ae-4fb7-9b4f-e7987377e055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.221039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafb69e-05ae-4fb7-9b4f-e7987377e055 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.226976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 63/123] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:31.232500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57425ab5-0a24-4c0c-affc-49976d616a43 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.244441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 61/124] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:31.250589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafb69e-05ae-4fb7-9b4f-e7987377e055 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.330143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.394523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57425ab5-0a24-4c0c-affc-49976d616a43 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.397098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafb69e-05ae-4fb7-9b4f-e7987377e055 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.448725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.455735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc58d-eb46-4f55-b696-e23df4d19be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.456376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc58d-eb46-4f55-b696-e23df4d19be3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.456658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc58d-eb46-4f55-b696-e23df4d19be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.456934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc58d-eb46-4f55-b696-e23df4d19be3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.461574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673f3ee-7986-48ce-8faf-0fb781c7c540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.462244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673f3ee-7986-48ce-8faf-0fb781c7c540 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.462532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673f3ee-7986-48ce-8faf-0fb781c7c540 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.462851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673f3ee-7986-48ce-8faf-0fb781c7c540 None admin] PATH_INFO: `/v3/users/59bd1470a00849b4b09de0a61612c525` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.464218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673f3ee-7986-48ce-8faf-0fb781c7c540 None admin] RBAC: Authorizing `identity:get_user(user_id=59bd1470a00849b4b09de0a61612c525)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.465801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673f3ee-7986-48ce-8faf-0fb781c7c540 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.471275 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 62/125] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/users/59bd1470a00849b4b09de0a61612c525 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:31.476921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673f3ee-7986-48ce-8faf-0fb781c7c540 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.481887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96dc58d-eb46-4f55-b696-e23df4d19be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b96dc58d-eb46-4f55-b696-e23df4d19be3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:31.492749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:31.493693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:31.494498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 64/126] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:31.503745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc58d-eb46-4f55-b696-e23df4d19be3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.685144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673f3ee-7986-48ce-8faf-0fb781c7c540 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.688272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc58d-eb46-4f55-b696-e23df4d19be3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.713052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.741977 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2e5ae-388f-48b0-8db2-b294606530ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.743077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e5ae-388f-48b0-8db2-b294606530ef None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.743603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e5ae-388f-48b0-8db2-b294606530ef None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.744220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e5ae-388f-48b0-8db2-b294606530ef None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.745335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81178a46-96e6-4671-8386-53e339e21d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.746073 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81178a46-96e6-4671-8386-53e339e21d08 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.746592 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2e5ae-388f-48b0-8db2-b294606530ef None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.746791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81178a46-96e6-4671-8386-53e339e21d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.747374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81178a46-96e6-4671-8386-53e339e21d08 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.748460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81178a46-96e6-4671-8386-53e339e21d08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:31.748859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81178a46-96e6-4671-8386-53e339e21d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.749426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2e5ae-388f-48b0-8db2-b294606530ef None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.750449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81178a46-96e6-4671-8386-53e339e21d08 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:31.751537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 63/127] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:31.757278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2e5ae-388f-48b0-8db2-b294606530ef None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.763013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 65/128] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:31.769554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81178a46-96e6-4671-8386-53e339e21d08 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:31.877333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:31.914251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2e5ae-388f-48b0-8db2-b294606530ef None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.946749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81178a46-96e6-4671-8386-53e339e21d08 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:31.960351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d5812-b0d9-404a-ab93-5ea00736f2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:31.963000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d5812-b0d9-404a-ab93-5ea00736f2ec None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:31.963425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d5812-b0d9-404a-ab93-5ea00736f2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:31.963632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d5812-b0d9-404a-ab93-5ea00736f2ec None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/users/59bd1470a00849b4b09de0a61612c525/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:31.966829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d5812-b0d9-404a-ab93-5ea00736f2ec None admin] RBAC: Authorizing `identity:create_grant(project_id=f4bff8a4031648c7b2f2ebfdb69f7137, user_id=59bd1470a00849b4b09de0a61612c525, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:31.975282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d5812-b0d9-404a-ab93-5ea00736f2ec None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:32.008113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a41444-bf92-4f7a-b3cb-6592ad96286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:32.008759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a41444-bf92-4f7a-b3cb-6592ad96286c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.009042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a41444-bf92-4f7a-b3cb-6592ad96286c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.009317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a41444-bf92-4f7a-b3cb-6592ad96286c None admin] PATH_INFO: `/v3/users/ee10149ebbe7496c866e705d002c15a9` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.010534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a41444-bf92-4f7a-b3cb-6592ad96286c None admin] RBAC: Authorizing `identity:get_user(user_id=ee10149ebbe7496c866e705d002c15a9)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:32.012132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a41444-bf92-4f7a-b3cb-6592ad96286c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:32.013921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 66/129] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:31 2022] GET /identity/v3/users/ee10149ebbe7496c866e705d002c15a9 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:32.014693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a41444-bf92-4f7a-b3cb-6592ad96286c None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:32.062369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:32.112997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 64/130] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:31 2022] PUT /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/users/59bd1470a00849b4b09de0a61612c525/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:07:32.113872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d5812-b0d9-404a-ab93-5ea00736f2ec None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:32.151463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a41444-bf92-4f7a-b3cb-6592ad96286c None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:32.241693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f7176-1a23-454e-9c5c-dda40e5890e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:32.242927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f7176-1a23-454e-9c5c-dda40e5890e7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.244630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f7176-1a23-454e-9c5c-dda40e5890e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.245182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f7176-1a23-454e-9c5c-dda40e5890e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.266984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f7176-1a23-454e-9c5c-dda40e5890e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-2a8f7176-1a23-454e-9c5c-dda40e5890e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:32.274890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:32.275814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:32.276559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:32.287605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 67/131] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:32.291406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fadd2-c63e-466c-a5ba-54705b36c613 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.292264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fadd2-c63e-466c-a5ba-54705b36c613 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.294109 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fadd2-c63e-466c-a5ba-54705b36c613 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.296448 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 68/132] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:32.302836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fadd2-c63e-466c-a5ba-54705b36c613 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:32.340012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d5812-b0d9-404a-ab93-5ea00736f2ec None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:32.372858 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:32.391703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc742c19-1973-45bb-92dd-3ae9188008fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:32.393504 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742c19-1973-45bb-92dd-3ae9188008fc None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.393811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742c19-1973-45bb-92dd-3ae9188008fc None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.394105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742c19-1973-45bb-92dd-3ae9188008fc None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.395346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc742c19-1973-45bb-92dd-3ae9188008fc None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:32.397482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc742c19-1973-45bb-92dd-3ae9188008fc None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:32.399182 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 65/133] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:32 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:32.400371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954acd7-b5e9-43e7-ac42-cf9e3f18197e None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.400656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954acd7-b5e9-43e7-ac42-cf9e3f18197e None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.400939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954acd7-b5e9-43e7-ac42-cf9e3f18197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.420975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c954acd7-b5e9-43e7-ac42-cf9e3f18197e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:32.425693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c954acd7-b5e9-43e7-ac42-cf9e3f18197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:32.495312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 66/134] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:32.496173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954acd7-b5e9-43e7-ac42-cf9e3f18197e None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:32.530413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fadd2-c63e-466c-a5ba-54705b36c613 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:32.550067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:32.602464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4eee-2631-47fb-b461-0ea54663a267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:32.602887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954acd7-b5e9-43e7-ac42-cf9e3f18197e None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:32.603153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4eee-2631-47fb-b461-0ea54663a267 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.603442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4eee-2631-47fb-b461-0ea54663a267 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.603725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4eee-2631-47fb-b461-0ea54663a267 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.604580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4eee-2631-47fb-b461-0ea54663a267 None admin] RBAC: Adding query filter params (name=member) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:32.604893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4eee-2631-47fb-b461-0ea54663a267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:32.606416 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4eee-2631-47fb-b461-0ea54663a267 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:32.622117 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 69/135] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:32.632285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4eee-2631-47fb-b461-0ea54663a267 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:32.635951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:32.644626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c8fc5-6d17-4f6e-9496-b742f5973eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:32.645347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c8fc5-6d17-4f6e-9496-b742f5973eb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.645636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c8fc5-6d17-4f6e-9496-b742f5973eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.646617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c8fc5-6d17-4f6e-9496-b742f5973eb0 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/users/ee10149ebbe7496c866e705d002c15a9/roles/3ba2e6e2ec814831bb3bc254484024d2` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.649278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c8fc5-6d17-4f6e-9496-b742f5973eb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4bff8a4031648c7b2f2ebfdb69f7137, user_id=ee10149ebbe7496c866e705d002c15a9, role_id=3ba2e6e2ec814831bb3bc254484024d2)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:32.650894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c8fc5-6d17-4f6e-9496-b742f5973eb0 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:32.744273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 67/136] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:32 2022] PUT /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/users/ee10149ebbe7496c866e705d002c15a9/roles/3ba2e6e2ec814831bb3bc254484024d2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:32.745871 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736868a-1983-472c-8217-cb41ee24dea0 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.746206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736868a-1983-472c-8217-cb41ee24dea0 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.746591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736868a-1983-472c-8217-cb41ee24dea0 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.748310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 68/137] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:32.750596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4eee-2631-47fb-b461-0ea54663a267 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:32.754068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dbc24-e4ec-415b-a929-62321db8f964 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.764441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dbc24-e4ec-415b-a929-62321db8f964 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.764441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dbc24-e4ec-415b-a929-62321db8f964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.789795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d86b64-0280-4c7f-9c9f-c3e5b5e86fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:32.790457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86b64-0280-4c7f-9c9f-c3e5b5e86fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:32.790742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86b64-0280-4c7f-9c9f-c3e5b5e86fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:32.791021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86b64-0280-4c7f-9c9f-c3e5b5e86fe7 None admin] PATH_INFO: `/v3/users/ee10149ebbe7496c866e705d002c15a9` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:32.791121 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-102dbc24-e4ec-415b-a929-62321db8f964 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:32.792241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d86b64-0280-4c7f-9c9f-c3e5b5e86fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=ee10149ebbe7496c866e705d002c15a9)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:32.792621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-102dbc24-e4ec-415b-a929-62321db8f964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:32.793718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d86b64-0280-4c7f-9c9f-c3e5b5e86fe7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:32.795590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 70/138] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:32 2022] GET /identity/v3/users/ee10149ebbe7496c866e705d002c15a9 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:32.801013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d86b64-0280-4c7f-9c9f-c3e5b5e86fe7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:32.835137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:32.943574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 69/139] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:32.944612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dbc24-e4ec-415b-a929-62321db8f964 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:33.000809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d86b64-0280-4c7f-9c9f-c3e5b5e86fe7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:33.065521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c8a31-2bfc-4ff1-bd4c-280c1574b327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:33.066217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c8a31-2bfc-4ff1-bd4c-280c1574b327 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.066503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c8a31-2bfc-4ff1-bd4c-280c1574b327 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.066781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c8a31-2bfc-4ff1-bd4c-280c1574b327 None admin] PATH_INFO: `/v3/projects/5784fee7e75c4c8baeb5cee82b8dd96d` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.069163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c8a31-2bfc-4ff1-bd4c-280c1574b327 None admin] RBAC: Authorizing `identity:get_project(project_id=5784fee7e75c4c8baeb5cee82b8dd96d)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:33.071011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c8a31-2bfc-4ff1-bd4c-280c1574b327 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:33.072694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 71/140] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:32 2022] GET /identity/v3/projects/5784fee7e75c4c8baeb5cee82b8dd96d => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:33.079399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c8a31-2bfc-4ff1-bd4c-280c1574b327 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:33.118448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dbc24-e4ec-415b-a929-62321db8f964 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:33.146166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:33.188686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f85b5f-452e-4c2b-abc1-7386b717b311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:33.189333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f85b5f-452e-4c2b-abc1-7386b717b311 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.189622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f85b5f-452e-4c2b-abc1-7386b717b311 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.189926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f85b5f-452e-4c2b-abc1-7386b717b311 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.191819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f85b5f-452e-4c2b-abc1-7386b717b311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:33.193886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f85b5f-452e-4c2b-abc1-7386b717b311 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:33.197729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 70/141] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:33.205802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f85b5f-452e-4c2b-abc1-7386b717b311 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:33.270127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:33.280417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c8a31-2bfc-4ff1-bd4c-280c1574b327 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:33.370443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c38a8f-28d2-435b-8a5b-beab671eb316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:33.371123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c38a8f-28d2-435b-8a5b-beab671eb316 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.371403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c38a8f-28d2-435b-8a5b-beab671eb316 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.371678 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c38a8f-28d2-435b-8a5b-beab671eb316 None admin] PATH_INFO: `/v3/projects/5784fee7e75c4c8baeb5cee82b8dd96d/users/ee10149ebbe7496c866e705d002c15a9/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.373603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c38a8f-28d2-435b-8a5b-beab671eb316 None admin] RBAC: Authorizing `identity:create_grant(project_id=5784fee7e75c4c8baeb5cee82b8dd96d, user_id=ee10149ebbe7496c866e705d002c15a9, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:33.375078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c38a8f-28d2-435b-8a5b-beab671eb316 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:33.397966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f85b5f-452e-4c2b-abc1-7386b717b311 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:33.436182 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a87f6-99f6-4643-ac22-e5051a0304c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:33.437217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a87f6-99f6-4643-ac22-e5051a0304c4 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.437738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a87f6-99f6-4643-ac22-e5051a0304c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.438263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a87f6-99f6-4643-ac22-e5051a0304c4 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.439123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a87f6-99f6-4643-ac22-e5051a0304c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:33.440851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a87f6-99f6-4643-ac22-e5051a0304c4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:33.512940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 72/142] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:33 2022] PUT /identity/v3/projects/5784fee7e75c4c8baeb5cee82b8dd96d/users/ee10149ebbe7496c866e705d002c15a9/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:33.517835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c38a8f-28d2-435b-8a5b-beab671eb316 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:33.546129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 71/143] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:33 2022] POST /identity/v3/users => generated 283 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:33.549089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03478fa-7c68-4037-8094-d61a09f54ae0 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.549721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03478fa-7c68-4037-8094-d61a09f54ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.550223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03478fa-7c68-4037-8094-d61a09f54ae0 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.553615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 72/144] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:33.563711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ecf6-0592-452f-b5bb-31d6866610ab None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.564295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ecf6-0592-452f-b5bb-31d6866610ab None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.564741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ecf6-0592-452f-b5bb-31d6866610ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.599513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-11e7ecf6-0592-452f-b5bb-31d6866610ab None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:33.601264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-11e7ecf6-0592-452f-b5bb-31d6866610ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:33.641376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:33.713437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 73/145] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:33.751502 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c38a8f-28d2-435b-8a5b-beab671eb316 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:33.806991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629622e5-f6bc-44e5-9be0-2a6aae00d10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:33.807555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629622e5-f6bc-44e5-9be0-2a6aae00d10d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:33.807839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629622e5-f6bc-44e5-9be0-2a6aae00d10d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:33.808106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629622e5-f6bc-44e5-9be0-2a6aae00d10d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:33.824870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629622e5-f6bc-44e5-9be0-2a6aae00d10d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-629622e5-f6bc-44e5-9be0-2a6aae00d10d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:33.829706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:33.830510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:33.831642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 73/146] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:33.837335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ecf6-0592-452f-b5bb-31d6866610ab None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:33.964792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ecf6-0592-452f-b5bb-31d6866610ab None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.007741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7166cb-abff-4127-985a-6864b8ea95f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.008378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7166cb-abff-4127-985a-6864b8ea95f2 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.008663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7166cb-abff-4127-985a-6864b8ea95f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.008939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7166cb-abff-4127-985a-6864b8ea95f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.009622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7166cb-abff-4127-985a-6864b8ea95f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:34.009950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7166cb-abff-4127-985a-6864b8ea95f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:34.011335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7166cb-abff-4127-985a-6864b8ea95f2 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:34.021337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 74/147] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:34.030772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629622e5-f6bc-44e5-9be0-2a6aae00d10d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.074843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.080710 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7166cb-abff-4127-985a-6864b8ea95f2 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.120989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.203118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7166cb-abff-4127-985a-6864b8ea95f2 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.258449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f7661-9b7a-4a5b-b06e-e26b68893cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.259165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f7661-9b7a-4a5b-b06e-e26b68893cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.259450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f7661-9b7a-4a5b-b06e-e26b68893cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.259673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629622e5-f6bc-44e5-9be0-2a6aae00d10d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.259775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f7661-9b7a-4a5b-b06e-e26b68893cd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.274549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f7661-9b7a-4a5b-b06e-e26b68893cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-f69f7661-9b7a-4a5b-b06e-e26b68893cd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:34.280914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:34.281902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:34.283396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 75/148] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:34.288124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f7661-9b7a-4a5b-b06e-e26b68893cd5 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.358482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a547766-c97f-4680-b067-4cde266b36c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.359169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a547766-c97f-4680-b067-4cde266b36c0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.359457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a547766-c97f-4680-b067-4cde266b36c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.359737 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a547766-c97f-4680-b067-4cde266b36c0 None admin] PATH_INFO: `/v3/users/5ae743ef64a045fbac2769c65d03ab8a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.360935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a547766-c97f-4680-b067-4cde266b36c0 None admin] RBAC: Authorizing `identity:get_user(user_id=5ae743ef64a045fbac2769c65d03ab8a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:34.362449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a547766-c97f-4680-b067-4cde266b36c0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:34.364399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 74/149] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/users/5ae743ef64a045fbac2769c65d03ab8a => generated 289 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:34.370654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a547766-c97f-4680-b067-4cde266b36c0 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.392141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.399103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f7661-9b7a-4a5b-b06e-e26b68893cd5 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.439299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1546ea-dd99-43ff-b3ac-3cab6af737bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.439925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1546ea-dd99-43ff-b3ac-3cab6af737bf None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.440208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1546ea-dd99-43ff-b3ac-3cab6af737bf None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.440486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1546ea-dd99-43ff-b3ac-3cab6af737bf None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.441173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1546ea-dd99-43ff-b3ac-3cab6af737bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:34.441482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1546ea-dd99-43ff-b3ac-3cab6af737bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:34.442969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1546ea-dd99-43ff-b3ac-3cab6af737bf None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:34.453782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 76/150] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:34.459405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1546ea-dd99-43ff-b3ac-3cab6af737bf None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.568366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1546ea-dd99-43ff-b3ac-3cab6af737bf None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.605486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211f90a-2f11-423e-becd-cee9a00489ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.606276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211f90a-2f11-423e-becd-cee9a00489ba None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.606559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211f90a-2f11-423e-becd-cee9a00489ba None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.606835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211f90a-2f11-423e-becd-cee9a00489ba None admin] PATH_INFO: `/v3/users/ee10149ebbe7496c866e705d002c15a9` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.608027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211f90a-2f11-423e-becd-cee9a00489ba None admin] RBAC: Authorizing `identity:get_user(user_id=ee10149ebbe7496c866e705d002c15a9)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:34.609686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211f90a-2f11-423e-becd-cee9a00489ba None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:34.611493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.611896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 77/151] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/users/ee10149ebbe7496c866e705d002c15a9 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:34.617455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211f90a-2f11-423e-becd-cee9a00489ba None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.642852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.653194 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a547766-c97f-4680-b067-4cde266b36c0 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.725534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211f90a-2f11-423e-becd-cee9a00489ba None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:34.746712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce69f46-79aa-4a6b-bc16-ef0a2d5b1be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.747078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce69f46-79aa-4a6b-bc16-ef0a2d5b1be6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.747363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce69f46-79aa-4a6b-bc16-ef0a2d5b1be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce69f46-79aa-4a6b-bc16-ef0a2d5b1be6 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.748851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce69f46-79aa-4a6b-bc16-ef0a2d5b1be6 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:34.750324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce69f46-79aa-4a6b-bc16-ef0a2d5b1be6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:34.752181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 75/152] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:34.757645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce69f46-79aa-4a6b-bc16-ef0a2d5b1be6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:34.760897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5fb5-e3fb-4fc2-b405-dc9284aa5537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:34.761521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5fb5-e3fb-4fc2-b405-dc9284aa5537 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.761842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5fb5-e3fb-4fc2-b405-dc9284aa5537 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.762120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5fb5-e3fb-4fc2-b405-dc9284aa5537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.835878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede5fb5-e3fb-4fc2-b405-dc9284aa5537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:34.837379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede5fb5-e3fb-4fc2-b405-dc9284aa5537 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:34.860539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:34.948183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 78/153] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:34.953432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e7bfe-d2b8-4d93-ba59-0ff65d617364 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:34.953752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e7bfe-d2b8-4d93-ba59-0ff65d617364 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:34.954033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e7bfe-d2b8-4d93-ba59-0ff65d617364 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:34.955364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 79/154] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:34.957021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e7bfe-d2b8-4d93-ba59-0ff65d617364 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.040151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce69f46-79aa-4a6b-bc16-ef0a2d5b1be6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.074946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e7bfe-d2b8-4d93-ba59-0ff65d617364 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.100036 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f55b2-0ce6-43da-94da-be6e14bd1c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.101094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f55b2-0ce6-43da-94da-be6e14bd1c73 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.101575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f55b2-0ce6-43da-94da-be6e14bd1c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.102085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f55b2-0ce6-43da-94da-be6e14bd1c73 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/users/5ae743ef64a045fbac2769c65d03ab8a/roles/d2ed58a85e7941fcadc0916d8c31fdb2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.104309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f55b2-0ce6-43da-94da-be6e14bd1c73 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4bff8a4031648c7b2f2ebfdb69f7137, user_id=5ae743ef64a045fbac2769c65d03ab8a, role_id=d2ed58a85e7941fcadc0916d8c31fdb2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.106045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f55b2-0ce6-43da-94da-be6e14bd1c73 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.106155 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:35.123184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7796a-7e38-4812-a2f5-12e6480a8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.123184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7796a-7e38-4812-a2f5-12e6480a8bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.123184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7796a-7e38-4812-a2f5-12e6480a8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.123184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7796a-7e38-4812-a2f5-12e6480a8bd0 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.123540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7796a-7e38-4812-a2f5-12e6480a8bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.123540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7796a-7e38-4812-a2f5-12e6480a8bd0 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.123540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 80/155] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:34 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:35.123540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498524c-155f-4eee-a0de-add97d26cc55 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.123540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498524c-155f-4eee-a0de-add97d26cc55 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.123540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498524c-155f-4eee-a0de-add97d26cc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.147230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-1498524c-155f-4eee-a0de-add97d26cc55 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:35.151988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1498524c-155f-4eee-a0de-add97d26cc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:35.180692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 76/156] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:34 2022] PUT /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/users/5ae743ef64a045fbac2769c65d03ab8a/roles/d2ed58a85e7941fcadc0916d8c31fdb2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:07:35.182149 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f55b2-0ce6-43da-94da-be6e14bd1c73 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.215107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:35.227783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 81/157] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:35.344197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f55b2-0ce6-43da-94da-be6e14bd1c73 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.385480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659c62-031a-438c-9b2f-6f853359ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.386124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659c62-031a-438c-9b2f-6f853359ae8b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.386407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659c62-031a-438c-9b2f-6f853359ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.386680 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659c62-031a-438c-9b2f-6f853359ae8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.387423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659c62-031a-438c-9b2f-6f853359ae8b None admin] RBAC: Adding query filter params (role.id=d1bf17fdde744527bb5905634f0b1b2c, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137, user.id=ee10149ebbe7496c866e705d002c15a9) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:35.387732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659c62-031a-438c-9b2f-6f853359ae8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:35.389184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659c62-031a-438c-9b2f-6f853359ae8b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:35.395542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 77/158] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:35 2022] GET /identity/v3/role_assignments?user.id=ee10149ebbe7496c866e705d002c15a9&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:35.749430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498524c-155f-4eee-a0de-add97d26cc55 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:35.878803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498524c-155f-4eee-a0de-add97d26cc55 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:35.899643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:35.921934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a78f7-5096-4eb9-b5a7-80ec880e412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:35.922649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a78f7-5096-4eb9-b5a7-80ec880e412e None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:35.922952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a78f7-5096-4eb9-b5a7-80ec880e412e None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:35.923213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a78f7-5096-4eb9-b5a7-80ec880e412e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:35.939263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a78f7-5096-4eb9-b5a7-80ec880e412e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-934a78f7-5096-4eb9-b5a7-80ec880e412e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:35.944848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:35.946028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:35.947442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 82/159] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:35.951997 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659c62-031a-438c-9b2f-6f853359ae8b None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.069002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:36.092598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659c62-031a-438c-9b2f-6f853359ae8b None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:36.105923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b360c-92aa-46ea-affa-c119f2491f17 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.106222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b360c-92aa-46ea-affa-c119f2491f17 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.106480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b360c-92aa-46ea-affa-c119f2491f17 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.108716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 83/160] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:36.114708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e778dc3-19fd-4bb1-8965-6be670c2fbe7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.116317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e778dc3-19fd-4bb1-8965-6be670c2fbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.116317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e778dc3-19fd-4bb1-8965-6be670c2fbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.142803 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b6d9-4ea6-4c35-b8e4-5c17d5f3c5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:36.143433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b6d9-4ea6-4c35-b8e4-5c17d5f3c5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.143714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b6d9-4ea6-4c35-b8e4-5c17d5f3c5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.143988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b6d9-4ea6-4c35-b8e4-5c17d5f3c5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.144746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3b6d9-4ea6-4c35-b8e4-5c17d5f3c5f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:36.145053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3b6d9-4ea6-4c35-b8e4-5c17d5f3c5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:36.147231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3b6d9-4ea6-4c35-b8e4-5c17d5f3c5f9 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:36.155694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-2e778dc3-19fd-4bb1-8965-6be670c2fbe7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:36.160048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2e778dc3-19fd-4bb1-8965-6be670c2fbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:36.166961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 78/161] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:36.172380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b6d9-4ea6-4c35-b8e4-5c17d5f3c5f9 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.344887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 84/162] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 19:07:36.350593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b6d9-4ea6-4c35-b8e4-5c17d5f3c5f9 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:36.397681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c1d68-6b44-4d39-8b19-3f523795dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:36.398341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c1d68-6b44-4d39-8b19-3f523795dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.398624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c1d68-6b44-4d39-8b19-3f523795dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.398904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c1d68-6b44-4d39-8b19-3f523795dcb0 None admin] PATH_INFO: `/v3/users/59bd1470a00849b4b09de0a61612c525` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.400051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c1d68-6b44-4d39-8b19-3f523795dcb0 None admin] RBAC: Authorizing `identity:get_user(user_id=59bd1470a00849b4b09de0a61612c525)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:36.401512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c1d68-6b44-4d39-8b19-3f523795dcb0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:36.403393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 79/163] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:36 2022] GET /identity/v3/users/59bd1470a00849b4b09de0a61612c525 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:36.408854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e778dc3-19fd-4bb1-8965-6be670c2fbe7 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.514085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e778dc3-19fd-4bb1-8965-6be670c2fbe7 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:36.525012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:36.550928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e6eac-b7d7-47c7-9cb2-8f979d0f3298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:36.551639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e6eac-b7d7-47c7-9cb2-8f979d0f3298 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.551998 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e6eac-b7d7-47c7-9cb2-8f979d0f3298 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.552283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e6eac-b7d7-47c7-9cb2-8f979d0f3298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.622928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e6eac-b7d7-47c7-9cb2-8f979d0f3298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:36.624320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e6eac-b7d7-47c7-9cb2-8f979d0f3298 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:36.729446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 85/164] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:36.734871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c1d68-6b44-4d39-8b19-3f523795dcb0 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.748154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:36.840636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c1d68-6b44-4d39-8b19-3f523795dcb0 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:36.844650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e6eac-b7d7-47c7-9cb2-8f979d0f3298 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.858020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:36.911692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a124027-c1f5-4f8f-b88a-189213cfea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:36.912265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124027-c1f5-4f8f-b88a-189213cfea2f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:36.912608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124027-c1f5-4f8f-b88a-189213cfea2f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:36.912882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124027-c1f5-4f8f-b88a-189213cfea2f None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:36.914183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a124027-c1f5-4f8f-b88a-189213cfea2f None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:36.915778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a124027-c1f5-4f8f-b88a-189213cfea2f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:36.917715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 80/165] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:36 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:36.943850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a124027-c1f5-4f8f-b88a-189213cfea2f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:36.969116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e6eac-b7d7-47c7-9cb2-8f979d0f3298 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:37.010755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfc65-8341-4c1d-9840-2fbfee301523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:37.011415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfc65-8341-4c1d-9840-2fbfee301523 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.011698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfc65-8341-4c1d-9840-2fbfee301523 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.025450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfc65-8341-4c1d-9840-2fbfee301523 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.025450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfc65-8341-4c1d-9840-2fbfee301523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-6d0bfc65-8341-4c1d-9840-2fbfee301523 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:37.030129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:37.031010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:37.032493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 86/166] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:37.038036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfc65-8341-4c1d-9840-2fbfee301523 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:37.100078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:37.116940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:37.146398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a124027-c1f5-4f8f-b88a-189213cfea2f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:37.166125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfc65-8341-4c1d-9840-2fbfee301523 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:37.215767 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e3282-9836-448b-83a4-98949cf679af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:37.216667 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e3282-9836-448b-83a4-98949cf679af None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.216952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e3282-9836-448b-83a4-98949cf679af None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.217230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e3282-9836-448b-83a4-98949cf679af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.218834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e3282-9836-448b-83a4-98949cf679af None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137, user.id=59bd1470a00849b4b09de0a61612c525) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:37.219147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e3282-9836-448b-83a4-98949cf679af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:37.220584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e3282-9836-448b-83a4-98949cf679af None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:37.232576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 81/167] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:36 2022] GET /identity/v3/role_assignments?user.id=59bd1470a00849b4b09de0a61612c525&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:37.237153 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d17ed-f6c9-4faf-8385-552a17ea31c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:37.237884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d17ed-f6c9-4faf-8385-552a17ea31c9 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.238167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d17ed-f6c9-4faf-8385-552a17ea31c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.238440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d17ed-f6c9-4faf-8385-552a17ea31c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.239137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d17ed-f6c9-4faf-8385-552a17ea31c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:37.239471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d17ed-f6c9-4faf-8385-552a17ea31c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:37.240934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d17ed-f6c9-4faf-8385-552a17ea31c9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:37.250801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 87/168] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:37.256631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e3282-9836-448b-83a4-98949cf679af None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:37.383094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e3282-9836-448b-83a4-98949cf679af None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:37.424725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b255a-7d94-4c22-94c1-7e6bd9b9de3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:37.425292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b255a-7d94-4c22-94c1-7e6bd9b9de3f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.425574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b255a-7d94-4c22-94c1-7e6bd9b9de3f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.425879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b255a-7d94-4c22-94c1-7e6bd9b9de3f None admin] PATH_INFO: `/v3/users/ee10149ebbe7496c866e705d002c15a9` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.427138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b255a-7d94-4c22-94c1-7e6bd9b9de3f None admin] RBAC: Authorizing `identity:get_user(user_id=ee10149ebbe7496c866e705d002c15a9)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:37.428614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b255a-7d94-4c22-94c1-7e6bd9b9de3f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:37.430702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 82/169] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:37 2022] GET /identity/v3/users/ee10149ebbe7496c866e705d002c15a9 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:37.436144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d17ed-f6c9-4faf-8385-552a17ea31c9 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:37.530699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d9cd0-bcb6-445e-9a55-dc0ebfa5a779 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.531013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d9cd0-bcb6-445e-9a55-dc0ebfa5a779 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.531242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d9cd0-bcb6-445e-9a55-dc0ebfa5a779 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.532930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 83/170] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:37.539126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce399-5cd8-4faa-9808-6e9dd7f12dd9 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.539543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce399-5cd8-4faa-9808-6e9dd7f12dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.539923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce399-5cd8-4faa-9808-6e9dd7f12dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.560235 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-433ce399-5cd8-4faa-9808-6e9dd7f12dd9 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:37.561504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-433ce399-5cd8-4faa-9808-6e9dd7f12dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:37.563987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d17ed-f6c9-4faf-8385-552a17ea31c9 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:37.566521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:37.604278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:37.615697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1572476-5cfe-4f00-b21c-ecde08c9d695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:37.616346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1572476-5cfe-4f00-b21c-ecde08c9d695 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.616632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1572476-5cfe-4f00-b21c-ecde08c9d695 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.616911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1572476-5cfe-4f00-b21c-ecde08c9d695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.688419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 84/171] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:37.689839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e47fb-df08-4606-bfd3-bdf238ee4762 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.690141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e47fb-df08-4606-bfd3-bdf238ee4762 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.690408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e47fb-df08-4606-bfd3-bdf238ee4762 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.691858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 85/172] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:37.699391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c1ed4-d0f1-4ae1-9e6f-3328e5036dc0 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:37.699676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c1ed4-d0f1-4ae1-9e6f-3328e5036dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:37.699961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c1ed4-d0f1-4ae1-9e6f-3328e5036dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:37.731713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-180c1ed4-d0f1-4ae1-9e6f-3328e5036dc0 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:37.732933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-180c1ed4-d0f1-4ae1-9e6f-3328e5036dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:37.798663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1572476-5cfe-4f00-b21c-ecde08c9d695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:37.800140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1572476-5cfe-4f00-b21c-ecde08c9d695 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:37.868700 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 86/173] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:37.990438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 88/174] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:37.996001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c1ed4-d0f1-4ae1-9e6f-3328e5036dc0 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.123596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:38.169325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c1ed4-d0f1-4ae1-9e6f-3328e5036dc0 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.175069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1572476-5cfe-4f00-b21c-ecde08c9d695 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.227255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:38.239422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfde44-c971-4c69-9a5b-9ed6ecd0e0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:38.240189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfde44-c971-4c69-9a5b-9ed6ecd0e0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.240530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfde44-c971-4c69-9a5b-9ed6ecd0e0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.240749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfde44-c971-4c69-9a5b-9ed6ecd0e0b3 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.241940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfde44-c971-4c69-9a5b-9ed6ecd0e0b3 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:38.243472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfde44-c971-4c69-9a5b-9ed6ecd0e0b3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:38.245389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 87/175] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:37 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:38.263056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfde44-c971-4c69-9a5b-9ed6ecd0e0b3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.346009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1572476-5cfe-4f00-b21c-ecde08c9d695 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.388947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b5117-1cfe-425f-b6d5-12156b589def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:38.389983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b5117-1cfe-425f-b6d5-12156b589def None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.390469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b5117-1cfe-425f-b6d5-12156b589def None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.390938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b5117-1cfe-425f-b6d5-12156b589def None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.408822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b5117-1cfe-425f-b6d5-12156b589def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-f70b5117-1cfe-425f-b6d5-12156b589def None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:38.414815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:38.415704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:38.416566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:38.418976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 89/176] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:38.420649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94522ebf-3c17-42d8-ab9a-246bcf01a94d None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.421161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94522ebf-3c17-42d8-ab9a-246bcf01a94d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.421636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94522ebf-3c17-42d8-ab9a-246bcf01a94d None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.422855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfde44-c971-4c69-9a5b-9ed6ecd0e0b3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.423319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 90/177] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:38.427842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94522ebf-3c17-42d8-ab9a-246bcf01a94d None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.464978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b14e9-31fc-4bf7-a655-7b79c6bd9b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:38.465895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b14e9-31fc-4bf7-a655-7b79c6bd9b02 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.466391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b14e9-31fc-4bf7-a655-7b79c6bd9b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.466866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b14e9-31fc-4bf7-a655-7b79c6bd9b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.467795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b14e9-31fc-4bf7-a655-7b79c6bd9b02 None admin] RBAC: Adding query filter params (role.id=3ba2e6e2ec814831bb3bc254484024d2, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137, user.id=ee10149ebbe7496c866e705d002c15a9) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:38.468322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b14e9-31fc-4bf7-a655-7b79c6bd9b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:38.470237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b14e9-31fc-4bf7-a655-7b79c6bd9b02 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:38.481424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 88/178] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/role_assignments?user.id=ee10149ebbe7496c866e705d002c15a9&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=3ba2e6e2ec814831bb3bc254484024d2 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:38.482327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b14e9-31fc-4bf7-a655-7b79c6bd9b02 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.486144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:38.590163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:38.619489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94522ebf-3c17-42d8-ab9a-246bcf01a94d None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.667899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969e71-a01d-4dba-b4ab-38b8079cf4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:38.668676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969e71-a01d-4dba-b4ab-38b8079cf4cb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.668965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969e71-a01d-4dba-b4ab-38b8079cf4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.669348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969e71-a01d-4dba-b4ab-38b8079cf4cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.678799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b14e9-31fc-4bf7-a655-7b79c6bd9b02 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.682098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969e71-a01d-4dba-b4ab-38b8079cf4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-b2969e71-a01d-4dba-b4ab-38b8079cf4cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:38.688334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:38.689426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:38.690222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:38.693086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 91/179] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:38.694677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899609f-bf84-4c07-b28d-ca6792b2b2d1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.695410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899609f-bf84-4c07-b28d-ca6792b2b2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.695864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899609f-bf84-4c07-b28d-ca6792b2b2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.717094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-d899609f-bf84-4c07-b28d-ca6792b2b2d1 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:38.718738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d899609f-bf84-4c07-b28d-ca6792b2b2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:38.719371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310f6fb-7d00-4b3e-8606-c7f4d9ade315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:38.719988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310f6fb-7d00-4b3e-8606-c7f4d9ade315 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.720268 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310f6fb-7d00-4b3e-8606-c7f4d9ade315 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.720542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310f6fb-7d00-4b3e-8606-c7f4d9ade315 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.721212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310f6fb-7d00-4b3e-8606-c7f4d9ade315 None admin] RBAC: Adding query filter params (name=member) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:38.721542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310f6fb-7d00-4b3e-8606-c7f4d9ade315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:38.723012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310f6fb-7d00-4b3e-8606-c7f4d9ade315 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:38.734744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 89/180] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:38.737083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41349a2e-544c-47e0-8f4a-edb428c459cf None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.737569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41349a2e-544c-47e0-8f4a-edb428c459cf None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.738062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41349a2e-544c-47e0-8f4a-edb428c459cf None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.739829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 90/181] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:38.740809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41349a2e-544c-47e0-8f4a-edb428c459cf None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.814548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 92/182] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:38.815691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899609f-bf84-4c07-b28d-ca6792b2b2d1 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:38.844275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:38.887798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41349a2e-544c-47e0-8f4a-edb428c459cf None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.921832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:38.923668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca70b8-05c8-4eb3-a499-b79447093ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:38.924307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca70b8-05c8-4eb3-a499-b79447093ddc None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.924561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca70b8-05c8-4eb3-a499-b79447093ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.924839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca70b8-05c8-4eb3-a499-b79447093ddc None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.925512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca70b8-05c8-4eb3-a499-b79447093ddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:38.925859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca70b8-05c8-4eb3-a499-b79447093ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:38.927819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca70b8-05c8-4eb3-a499-b79447093ddc None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:38.936626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 91/183] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:38.938026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690684d-be38-46ca-a3e9-4bf4c96586aa None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.938315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690684d-be38-46ca-a3e9-4bf4c96586aa None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.938595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690684d-be38-46ca-a3e9-4bf4c96586aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.948099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899609f-bf84-4c07-b28d-ca6792b2b2d1 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:38.960437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5690684d-be38-46ca-a3e9-4bf4c96586aa None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:38.961649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5690684d-be38-46ca-a3e9-4bf4c96586aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:38.988062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ea34c-aab8-4203-b5b1-263e378787af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:38.988694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea34c-aab8-4203-b5b1-263e378787af None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.988971 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea34c-aab8-4203-b5b1-263e378787af None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.989232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea34c-aab8-4203-b5b1-263e378787af None admin] PATH_INFO: `/v3/users/ee10149ebbe7496c866e705d002c15a9` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.990963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ea34c-aab8-4203-b5b1-263e378787af None admin] RBAC: Authorizing `identity:get_user(user_id=ee10149ebbe7496c866e705d002c15a9)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:38.992410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ea34c-aab8-4203-b5b1-263e378787af None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:38.994204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 93/184] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/users/ee10149ebbe7496c866e705d002c15a9 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:38.995156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767f183-4f69-472e-96d7-4d9d27df6acc None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:38.995427 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767f183-4f69-472e-96d7-4d9d27df6acc None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:38.996011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767f183-4f69-472e-96d7-4d9d27df6acc None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:38.997022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 94/185] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:38.997577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767f183-4f69-472e-96d7-4d9d27df6acc None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.044161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 92/186] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:39.044837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690684d-be38-46ca-a3e9-4bf4c96586aa None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.133313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.180419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690684d-be38-46ca-a3e9-4bf4c96586aa None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.181928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767f183-4f69-472e-96d7-4d9d27df6acc None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.217527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea791cde-15d0-4e3a-9e30-1a2e952cbfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.218422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea791cde-15d0-4e3a-9e30-1a2e952cbfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.218883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea791cde-15d0-4e3a-9e30-1a2e952cbfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.219089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd04280-69c6-4563-90fe-221721bf87d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.219464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea791cde-15d0-4e3a-9e30-1a2e952cbfd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.219868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd04280-69c6-4563-90fe-221721bf87d1 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.220241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd04280-69c6-4563-90fe-221721bf87d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.220556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd04280-69c6-4563-90fe-221721bf87d1 None admin] PATH_INFO: `/v3/users/314920a3226a4fb4b3474ef393b1e45a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.235189 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd04280-69c6-4563-90fe-221721bf87d1 None admin] RBAC: Authorizing `identity:get_user(user_id=314920a3226a4fb4b3474ef393b1e45a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.236899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd04280-69c6-4563-90fe-221721bf87d1 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.238643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 95/187] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:38 2022] GET /identity/v3/users/314920a3226a4fb4b3474ef393b1e45a => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:39.240468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1960d-d950-45f7-93b1-0a2377b08147 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.240943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1960d-d950-45f7-93b1-0a2377b08147 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.241349 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1960d-d950-45f7-93b1-0a2377b08147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.257605 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.265514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-bff1960d-d950-45f7-93b1-0a2377b08147 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:39.266797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bff1960d-d950-45f7-93b1-0a2377b08147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:39.299112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea791cde-15d0-4e3a-9e30-1a2e952cbfd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.300574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea791cde-15d0-4e3a-9e30-1a2e952cbfd0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.343222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 96/188] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:39.344062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1960d-d950-45f7-93b1-0a2377b08147 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.363312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.409304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 93/189] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:39.413952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea791cde-15d0-4e3a-9e30-1a2e952cbfd0 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.458067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1960d-d950-45f7-93b1-0a2377b08147 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.492616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e35e7-f89d-4629-8f52-31993c5f3dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.493363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e35e7-f89d-4629-8f52-31993c5f3dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.493643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e35e7-f89d-4629-8f52-31993c5f3dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.493944 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e35e7-f89d-4629-8f52-31993c5f3dd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.496600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.505772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e35e7-f89d-4629-8f52-31993c5f3dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-dc5e35e7-f89d-4629-8f52-31993c5f3dd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:39.511640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:39.512594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:39.513366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 97/190] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:39.518451 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e35e7-f89d-4629-8f52-31993c5f3dd3 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.523533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea791cde-15d0-4e3a-9e30-1a2e952cbfd0 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.559554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df2084-b207-4dec-bda4-82c2c38c09df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.560221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df2084-b207-4dec-bda4-82c2c38c09df None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.560505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df2084-b207-4dec-bda4-82c2c38c09df None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.560776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df2084-b207-4dec-bda4-82c2c38c09df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.588385 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.627100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e35e7-f89d-4629-8f52-31993c5f3dd3 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.634209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df2084-b207-4dec-bda4-82c2c38c09df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.635668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df2084-b207-4dec-bda4-82c2c38c09df None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.661849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094a808-7d30-4ed6-aa09-60f47479356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.662426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094a808-7d30-4ed6-aa09-60f47479356f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.662706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094a808-7d30-4ed6-aa09-60f47479356f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.662978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094a808-7d30-4ed6-aa09-60f47479356f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.673114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094a808-7d30-4ed6-aa09-60f47479356f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-8094a808-7d30-4ed6-aa09-60f47479356f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:39.678062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:39.679101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:39.679924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 98/191] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:39.680572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094a808-7d30-4ed6-aa09-60f47479356f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.736166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.742458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 94/192] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:39.742458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df2084-b207-4dec-bda4-82c2c38c09df None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.786281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094a808-7d30-4ed6-aa09-60f47479356f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.794049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.823922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984ce34-2654-470f-a4cb-ee4f0cd34d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.824569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ce34-2654-470f-a4cb-ee4f0cd34d2e None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.824849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ce34-2654-470f-a4cb-ee4f0cd34d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.825129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ce34-2654-470f-a4cb-ee4f0cd34d2e None admin] PATH_INFO: `/v3/projects/5784fee7e75c4c8baeb5cee82b8dd96d` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.826598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984ce34-2654-470f-a4cb-ee4f0cd34d2e None admin] RBAC: Authorizing `identity:get_project(project_id=5784fee7e75c4c8baeb5cee82b8dd96d)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.828060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984ce34-2654-470f-a4cb-ee4f0cd34d2e None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.829760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 99/193] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/projects/5784fee7e75c4c8baeb5cee82b8dd96d => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:39.833548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984ce34-2654-470f-a4cb-ee4f0cd34d2e None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.842043 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df2084-b207-4dec-bda4-82c2c38c09df None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.876653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138c10f-dee4-4a95-aaeb-195865087c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.877291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138c10f-dee4-4a95-aaeb-195865087c1f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.877572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138c10f-dee4-4a95-aaeb-195865087c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.877889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138c10f-dee4-4a95-aaeb-195865087c1f None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.878774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138c10f-dee4-4a95-aaeb-195865087c1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:39.879081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138c10f-dee4-4a95-aaeb-195865087c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.881193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138c10f-dee4-4a95-aaeb-195865087c1f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.889892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 95/194] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:39.890673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138c10f-dee4-4a95-aaeb-195865087c1f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.935949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984ce34-2654-470f-a4cb-ee4f0cd34d2e None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:39.959831 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:39.970439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bd0d0-0ef1-4b4a-9cc5-03c09e243d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:39.974603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bd0d0-0ef1-4b4a-9cc5-03c09e243d43 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:39.974603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bd0d0-0ef1-4b4a-9cc5-03c09e243d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:39.974603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bd0d0-0ef1-4b4a-9cc5-03c09e243d43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:39.974603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bd0d0-0ef1-4b4a-9cc5-03c09e243d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:39.974603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bd0d0-0ef1-4b4a-9cc5-03c09e243d43 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:39.976049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 100/195] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:39.976049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bd0d0-0ef1-4b4a-9cc5-03c09e243d43 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:39.987795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138c10f-dee4-4a95-aaeb-195865087c1f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.006227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.023589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e5c13-b75d-49c4-b475-0c279dd16a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.024196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e5c13-b75d-49c4-b475-0c279dd16a3e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.024791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e5c13-b75d-49c4-b475-0c279dd16a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.024791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e5c13-b75d-49c4-b475-0c279dd16a3e None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.025413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e5c13-b75d-49c4-b475-0c279dd16a3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:40.025797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e5c13-b75d-49c4-b475-0c279dd16a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.027223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e5c13-b75d-49c4-b475-0c279dd16a3e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.035853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 96/196] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.036705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e5c13-b75d-49c4-b475-0c279dd16a3e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.083580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bd0d0-0ef1-4b4a-9cc5-03c09e243d43 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.117976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652541-8659-4d0e-bab0-956cdf7f53fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.118749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652541-8659-4d0e-bab0-956cdf7f53fe None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.119042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652541-8659-4d0e-bab0-956cdf7f53fe None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.119429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652541-8659-4d0e-bab0-956cdf7f53fe None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.120565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3652541-8659-4d0e-bab0-956cdf7f53fe None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.122034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3652541-8659-4d0e-bab0-956cdf7f53fe None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.123667 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 101/197] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:39 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.124428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652541-8659-4d0e-bab0-956cdf7f53fe None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.142023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e5c13-b75d-49c4-b475-0c279dd16a3e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.176231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71107944-217b-497f-8805-a226f286d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.176834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71107944-217b-497f-8805-a226f286d81e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.177179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71107944-217b-497f-8805-a226f286d81e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.177454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71107944-217b-497f-8805-a226f286d81e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.178302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71107944-217b-497f-8805-a226f286d81e None admin] RBAC: Adding query filter params (role.id=d1bf17fdde744527bb5905634f0b1b2c, scope.project.id=5784fee7e75c4c8baeb5cee82b8dd96d, user.id=ee10149ebbe7496c866e705d002c15a9) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:40.178613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71107944-217b-497f-8805-a226f286d81e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.180103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71107944-217b-497f-8805-a226f286d81e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.184639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.186313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 97/198] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/role_assignments?user.id=ee10149ebbe7496c866e705d002c15a9&scope.project.id=5784fee7e75c4c8baeb5cee82b8dd96d&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.187026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71107944-217b-497f-8805-a226f286d81e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.232393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3652541-8659-4d0e-bab0-956cdf7f53fe None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.245057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.273262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b30e1e-3026-41d0-bd44-24edb2eac721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.273961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b30e1e-3026-41d0-bd44-24edb2eac721 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.274274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b30e1e-3026-41d0-bd44-24edb2eac721 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.274558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b30e1e-3026-41d0-bd44-24edb2eac721 None admin] PATH_INFO: `/v3/users/314920a3226a4fb4b3474ef393b1e45a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.275784 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b30e1e-3026-41d0-bd44-24edb2eac721 None admin] RBAC: Authorizing `identity:get_user(user_id=314920a3226a4fb4b3474ef393b1e45a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.277360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b30e1e-3026-41d0-bd44-24edb2eac721 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.279234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 102/199] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/users/314920a3226a4fb4b3474ef393b1e45a => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.279953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b30e1e-3026-41d0-bd44-24edb2eac721 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.314091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71107944-217b-497f-8805-a226f286d81e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.355066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e4dac-b54a-40d7-a6a6-d6a2e35bb64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.355526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e4dac-b54a-40d7-a6a6-d6a2e35bb64c None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.355810 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e4dac-b54a-40d7-a6a6-d6a2e35bb64c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.356087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e4dac-b54a-40d7-a6a6-d6a2e35bb64c None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.357064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e4dac-b54a-40d7-a6a6-d6a2e35bb64c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.358302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e4dac-b54a-40d7-a6a6-d6a2e35bb64c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.403385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b30e1e-3026-41d0-bd44-24edb2eac721 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.430139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.437587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc86817-944f-45a4-bb41-61fe541e0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.438192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc86817-944f-45a4-bb41-61fe541e0eca None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.438479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc86817-944f-45a4-bb41-61fe541e0eca None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.438761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc86817-944f-45a4-bb41-61fe541e0eca None admin] PATH_INFO: `/v3/users/5ae743ef64a045fbac2769c65d03ab8a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.439878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc86817-944f-45a4-bb41-61fe541e0eca None admin] RBAC: Authorizing `identity:get_user(user_id=5ae743ef64a045fbac2769c65d03ab8a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.441325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc86817-944f-45a4-bb41-61fe541e0eca None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.443122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 103/200] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/users/5ae743ef64a045fbac2769c65d03ab8a => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.443834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc86817-944f-45a4-bb41-61fe541e0eca None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.496132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 98/201] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:40 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:40.500227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e4dac-b54a-40d7-a6a6-d6a2e35bb64c None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.562816 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc86817-944f-45a4-bb41-61fe541e0eca None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.600888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b2313-728f-4696-8c2e-cc3cb786dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.601517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2313-728f-4696-8c2e-cc3cb786dabb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.601905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2313-728f-4696-8c2e-cc3cb786dabb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.602183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2313-728f-4696-8c2e-cc3cb786dabb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.602938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b2313-728f-4696-8c2e-cc3cb786dabb None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=c85373107052445eb6721136e8247abd, user.id=314920a3226a4fb4b3474ef393b1e45a) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:40.603255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b2313-728f-4696-8c2e-cc3cb786dabb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.604745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b2313-728f-4696-8c2e-cc3cb786dabb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.613703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 104/202] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/role_assignments?user.id=314920a3226a4fb4b3474ef393b1e45a&scope.project.id=c85373107052445eb6721136e8247abd&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:40.614624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b2313-728f-4696-8c2e-cc3cb786dabb None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.618938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.624930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e4dac-b54a-40d7-a6a6-d6a2e35bb64c None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.672225 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbea6c-7987-4347-a2f7-f0dbb1a4c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.672468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbea6c-7987-4347-a2f7-f0dbb1a4c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.672568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbea6c-7987-4347-a2f7-f0dbb1a4c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.672996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbea6c-7987-4347-a2f7-f0dbb1a4c1d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.698866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.756897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b2313-728f-4696-8c2e-cc3cb786dabb None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:40.773734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbea6c-7987-4347-a2f7-f0dbb1a4c1d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.777298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbea6c-7987-4347-a2f7-f0dbb1a4c1d7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.808840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12d0fd-441c-443d-8000-32e18522b5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:40.809531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12d0fd-441c-443d-8000-32e18522b5ec None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:40.809846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12d0fd-441c-443d-8000-32e18522b5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:40.810122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12d0fd-441c-443d-8000-32e18522b5ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:40.903617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12d0fd-441c-443d-8000-32e18522b5ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:40.905379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12d0fd-441c-443d-8000-32e18522b5ec None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:40.907166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:40.913653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 99/203] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:40.918363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbea6c-7987-4347-a2f7-f0dbb1a4c1d7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:40.986143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:41.039873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 105/204] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:41.046165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12d0fd-441c-443d-8000-32e18522b5ec None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:41.068432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbea6c-7987-4347-a2f7-f0dbb1a4c1d7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:41.119533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db567ca-4357-488f-a52c-1b92fa3b8974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:41.119533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db567ca-4357-488f-a52c-1b92fa3b8974 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:41.119533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db567ca-4357-488f-a52c-1b92fa3b8974 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:41.119533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db567ca-4357-488f-a52c-1b92fa3b8974 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:41.120736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db567ca-4357-488f-a52c-1b92fa3b8974 None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:41.122755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db567ca-4357-488f-a52c-1b92fa3b8974 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:41.125021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 100/205] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:40 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:41.133203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db567ca-4357-488f-a52c-1b92fa3b8974 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:41.177863 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12d0fd-441c-443d-8000-32e18522b5ec None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:41.221435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:41.226965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d12a3-cc80-4e59-8679-58a1737e4b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:41.227929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d12a3-cc80-4e59-8679-58a1737e4b74 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:41.228456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d12a3-cc80-4e59-8679-58a1737e4b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:41.228925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d12a3-cc80-4e59-8679-58a1737e4b74 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:41.230558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d12a3-cc80-4e59-8679-58a1737e4b74 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:41.235003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d12a3-cc80-4e59-8679-58a1737e4b74 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:41.238530 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 106/206] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:41 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:41.244381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d12a3-cc80-4e59-8679-58a1737e4b74 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:41.283868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:41.311816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db567ca-4357-488f-a52c-1b92fa3b8974 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:41.379695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d12a3-cc80-4e59-8679-58a1737e4b74 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:41.396793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635e38d-1854-4a9b-aa1e-047634af2f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:41.397418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e38d-1854-4a9b-aa1e-047634af2f29 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:41.397722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e38d-1854-4a9b-aa1e-047634af2f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:41.398000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e38d-1854-4a9b-aa1e-047634af2f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:41.398734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635e38d-1854-4a9b-aa1e-047634af2f29 None admin] RBAC: Adding query filter params (role.id=3ba2e6e2ec814831bb3bc254484024d2, scope.project.id=c85373107052445eb6721136e8247abd, user.id=314920a3226a4fb4b3474ef393b1e45a) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:41.399039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635e38d-1854-4a9b-aa1e-047634af2f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:41.400489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635e38d-1854-4a9b-aa1e-047634af2f29 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:41.415873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 101/207] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:41 2022] GET /identity/v3/role_assignments?user.id=314920a3226a4fb4b3474ef393b1e45a&scope.project.id=c85373107052445eb6721136e8247abd&role.id=3ba2e6e2ec814831bb3bc254484024d2 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:41.422411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74f5f6-c95e-45e5-90ea-0bf6a12e0b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:41.423433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f5f6-c95e-45e5-90ea-0bf6a12e0b77 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:41.423935 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f5f6-c95e-45e5-90ea-0bf6a12e0b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:41.424402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74f5f6-c95e-45e5-90ea-0bf6a12e0b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:41.425466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74f5f6-c95e-45e5-90ea-0bf6a12e0b77 None admin] RBAC: Adding query filter params (role.id=d2ed58a85e7941fcadc0916d8c31fdb2, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137, user.id=5ae743ef64a045fbac2769c65d03ab8a) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:41.426223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74f5f6-c95e-45e5-90ea-0bf6a12e0b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:41.428557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74f5f6-c95e-45e5-90ea-0bf6a12e0b77 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:41.435895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 107/208] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:41 2022] GET /identity/v3/role_assignments?user.id=5ae743ef64a045fbac2769c65d03ab8a&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=d2ed58a85e7941fcadc0916d8c31fdb2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:42.712266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f41b8-76fb-4ec5-902b-39dd87d5cf53 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:42.712782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f41b8-76fb-4ec5-902b-39dd87d5cf53 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:42.712782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f41b8-76fb-4ec5-902b-39dd87d5cf53 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:42.714214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 102/209] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:42.719677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914d67-031b-4cc8-b1bc-53af636b98ce None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:42.720105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914d67-031b-4cc8-b1bc-53af636b98ce None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:42.720299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914d67-031b-4cc8-b1bc-53af636b98ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:42.739915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b5914d67-031b-4cc8-b1bc-53af636b98ce None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:42.741108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b5914d67-031b-4cc8-b1bc-53af636b98ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:42.796373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27463c-0113-462f-bf4d-63b11c9e4ff0 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:42.796677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27463c-0113-462f-bf4d-63b11c9e4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:42.796923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27463c-0113-462f-bf4d-63b11c9e4ff0 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:42.798559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 103/210] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:42.806779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497568b-854d-495e-8358-6074fb0b8c4e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:42.807190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497568b-854d-495e-8358-6074fb0b8c4e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:42.807566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497568b-854d-495e-8358-6074fb0b8c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:42.821533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 108/211] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:42.837782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-8497568b-854d-495e-8358-6074fb0b8c4e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:42.839260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8497568b-854d-495e-8358-6074fb0b8c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:42.910781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 104/212] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:43.062279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff831546-7b94-413d-976f-038c0032825d None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.062516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff831546-7b94-413d-976f-038c0032825d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.062765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff831546-7b94-413d-976f-038c0032825d None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.064173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 109/213] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:43.069615 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa497b8-95dd-47d9-8961-2d3b4b63473b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.069927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa497b8-95dd-47d9-8961-2d3b4b63473b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.070628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa497b8-95dd-47d9-8961-2d3b4b63473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.091963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1fa497b8-95dd-47d9-8961-2d3b4b63473b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:43.093550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1fa497b8-95dd-47d9-8961-2d3b4b63473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:43.097449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff831546-7b94-413d-976f-038c0032825d None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:43.128647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:43.171100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:43.183794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 105/214] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:43.212042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa497b8-95dd-47d9-8961-2d3b4b63473b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:43.252739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff831546-7b94-413d-976f-038c0032825d None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:43.290348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dd96a-41f1-448d-b301-0b0822d7641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:43.290986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dd96a-41f1-448d-b301-0b0822d7641d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.291264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dd96a-41f1-448d-b301-0b0822d7641d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.291545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dd96a-41f1-448d-b301-0b0822d7641d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.303098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dd96a-41f1-448d-b301-0b0822d7641d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-a23dd96a-41f1-448d-b301-0b0822d7641d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:43.308156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:43.309872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:43.311397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 110/215] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:43.320216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dd96a-41f1-448d-b301-0b0822d7641d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:43.404359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa497b8-95dd-47d9-8961-2d3b4b63473b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:43.461901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:43.476723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb3db3-8f71-4b4a-a448-2ee06cae00d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:43.478334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb3db3-8f71-4b4a-a448-2ee06cae00d6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.479382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb3db3-8f71-4b4a-a448-2ee06cae00d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.480054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb3db3-8f71-4b4a-a448-2ee06cae00d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.492008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dd96a-41f1-448d-b301-0b0822d7641d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:43.501156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb3db3-8f71-4b4a-a448-2ee06cae00d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-2fcb3db3-8f71-4b4a-a448-2ee06cae00d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:43.509412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:43.510490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:43.511462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:43.513699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 106/216] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:43.514241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb3db3-8f71-4b4a-a448-2ee06cae00d6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:43.541140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6585d-8517-49cf-a36a-00eb1f03dc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:43.541793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6585d-8517-49cf-a36a-00eb1f03dc81 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.542086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6585d-8517-49cf-a36a-00eb1f03dc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.542422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6585d-8517-49cf-a36a-00eb1f03dc81 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.543116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6585d-8517-49cf-a36a-00eb1f03dc81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:43.543540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6585d-8517-49cf-a36a-00eb1f03dc81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:43.544939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6585d-8517-49cf-a36a-00eb1f03dc81 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:43.554256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 111/217] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:43.560417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a4eb3-294c-4dcd-b67c-f6b920f59066 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.560711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a4eb3-294c-4dcd-b67c-f6b920f59066 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.561018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a4eb3-294c-4dcd-b67c-f6b920f59066 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.562322 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 112/218] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:43.563062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a4eb3-294c-4dcd-b67c-f6b920f59066 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:43.574882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:43.626154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb3db3-8f71-4b4a-a448-2ee06cae00d6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:43.662416 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71983e57-899e-4b8b-bf65-cf6bee53d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:43.663049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71983e57-899e-4b8b-bf65-cf6bee53d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.663332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71983e57-899e-4b8b-bf65-cf6bee53d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.663610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71983e57-899e-4b8b-bf65-cf6bee53d2d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.664729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71983e57-899e-4b8b-bf65-cf6bee53d2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:43.666298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71983e57-899e-4b8b-bf65-cf6bee53d2d1 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:43.667888 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 107/219] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:43.668666 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71983e57-899e-4b8b-bf65-cf6bee53d2d1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:43.671496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a4eb3-294c-4dcd-b67c-f6b920f59066 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:43.707757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5c60f-921b-4ef7-9ab2-ef1dd5eae1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:43.708421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c60f-921b-4ef7-9ab2-ef1dd5eae1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.708700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c60f-921b-4ef7-9ab2-ef1dd5eae1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.708970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c60f-921b-4ef7-9ab2-ef1dd5eae1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.709641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5c60f-921b-4ef7-9ab2-ef1dd5eae1c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:43.709972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5c60f-921b-4ef7-9ab2-ef1dd5eae1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:43.711338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5c60f-921b-4ef7-9ab2-ef1dd5eae1c3 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:43.720429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 113/220] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:43.721441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204779cf-1187-4f72-a583-43cb02e6f5dc None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.721803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204779cf-1187-4f72-a583-43cb02e6f5dc None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.722026 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204779cf-1187-4f72-a583-43cb02e6f5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.733778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:43.740192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-204779cf-1187-4f72-a583-43cb02e6f5dc None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:43.741377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-204779cf-1187-4f72-a583-43cb02e6f5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:43.773306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71983e57-899e-4b8b-bf65-cf6bee53d2d1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:43.795334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:43.810226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beebea-3c0a-4d8b-86e5-3df402e86ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:43.810868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beebea-3c0a-4d8b-86e5-3df402e86ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.811149 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beebea-3c0a-4d8b-86e5-3df402e86ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.811424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beebea-3c0a-4d8b-86e5-3df402e86ee9 None admin] PATH_INFO: `/v3/users/c9f64586d1a348649339ce1a3cf98a9a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.812330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 114/221] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:43.813177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204779cf-1187-4f72-a583-43cb02e6f5dc None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:43.834658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beebea-3c0a-4d8b-86e5-3df402e86ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=c9f64586d1a348649339ce1a3cf98a9a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:43.836092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beebea-3c0a-4d8b-86e5-3df402e86ee9 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:43.837860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 108/222] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:43 2022] GET /identity/v3/users/c9f64586d1a348649339ce1a3cf98a9a => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:43.838664 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beebea-3c0a-4d8b-86e5-3df402e86ee9 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:43.937937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204779cf-1187-4f72-a583-43cb02e6f5dc None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:43.960269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beebea-3c0a-4d8b-86e5-3df402e86ee9 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:43.974339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76121f42-9b73-4ca4-ba33-2093aedbc60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:43.974968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121f42-9b73-4ca4-ba33-2093aedbc60c None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:43.978495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121f42-9b73-4ca4-ba33-2093aedbc60c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:43.978495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121f42-9b73-4ca4-ba33-2093aedbc60c None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:43.978495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76121f42-9b73-4ca4-ba33-2093aedbc60c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:43.978495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76121f42-9b73-4ca4-ba33-2093aedbc60c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:43.986797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:43.998184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25437f16-a0a6-4ce2-8d72-ad79a617ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:44.010362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437f16-a0a6-4ce2-8d72-ad79a617ddfa None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.010362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437f16-a0a6-4ce2-8d72-ad79a617ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.010362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437f16-a0a6-4ce2-8d72-ad79a617ddfa None admin] PATH_INFO: `/v3/users/314920a3226a4fb4b3474ef393b1e45a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.010362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25437f16-a0a6-4ce2-8d72-ad79a617ddfa None admin] RBAC: Authorizing `identity:get_user(user_id=314920a3226a4fb4b3474ef393b1e45a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:44.010362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25437f16-a0a6-4ce2-8d72-ad79a617ddfa None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:44.010362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 109/223] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:43 2022] GET /identity/v3/users/314920a3226a4fb4b3474ef393b1e45a => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:44.010807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25437f16-a0a6-4ce2-8d72-ad79a617ddfa None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:44.052675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:44.104566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25437f16-a0a6-4ce2-8d72-ad79a617ddfa None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:44.113888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 115/224] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:43 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:44.115559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76121f42-9b73-4ca4-ba33-2093aedbc60c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:44.144663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe79a6f-d43a-4807-8a2f-db55eb66be27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:44.145291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79a6f-d43a-4807-8a2f-db55eb66be27 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.145648 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79a6f-d43a-4807-8a2f-db55eb66be27 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.146038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79a6f-d43a-4807-8a2f-db55eb66be27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.230518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe79a6f-d43a-4807-8a2f-db55eb66be27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:44.232162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe79a6f-d43a-4807-8a2f-db55eb66be27 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:44.234744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76121f42-9b73-4ca4-ba33-2093aedbc60c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:44.279889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcfa47-6e9b-440f-9b08-770c84e0fab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:44.280347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcfa47-6e9b-440f-9b08-770c84e0fab0 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.280705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcfa47-6e9b-440f-9b08-770c84e0fab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.280988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcfa47-6e9b-440f-9b08-770c84e0fab0 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.282275 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcfa47-6e9b-440f-9b08-770c84e0fab0 None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:44.283783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcfa47-6e9b-440f-9b08-770c84e0fab0 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:44.287768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 116/225] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:44 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:44.287768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcfa47-6e9b-440f-9b08-770c84e0fab0 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:44.291442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:44.359216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 110/226] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:44.360076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe79a6f-d43a-4807-8a2f-db55eb66be27 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:44.365859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:44.425276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcfa47-6e9b-440f-9b08-770c84e0fab0 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:44.477425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940bb98-31b6-41d9-a830-02540405123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:44.478201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940bb98-31b6-41d9-a830-02540405123e None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.478494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940bb98-31b6-41d9-a830-02540405123e None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.478778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940bb98-31b6-41d9-a830-02540405123e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.492836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940bb98-31b6-41d9-a830-02540405123e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-7940bb98-31b6-41d9-a830-02540405123e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:44.498500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:44.499391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:44.500167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 117/227] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:44.500789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940bb98-31b6-41d9-a830-02540405123e None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:44.500851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe79a6f-d43a-4807-8a2f-db55eb66be27 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:44.548188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441a2b8-7d27-4f08-8756-460232d27077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:44.549859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a2b8-7d27-4f08-8756-460232d27077 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.550342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a2b8-7d27-4f08-8756-460232d27077 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.550813 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a2b8-7d27-4f08-8756-460232d27077 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd/users/314920a3226a4fb4b3474ef393b1e45a/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.554324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441a2b8-7d27-4f08-8756-460232d27077 None admin] RBAC: Authorizing `identity:create_grant(project_id=c85373107052445eb6721136e8247abd, user_id=314920a3226a4fb4b3474ef393b1e45a, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:44.556412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441a2b8-7d27-4f08-8756-460232d27077 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:44.617980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 111/228] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:44 2022] PUT /identity/v3/projects/c85373107052445eb6721136e8247abd/users/314920a3226a4fb4b3474ef393b1e45a/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:44.626219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940bb98-31b6-41d9-a830-02540405123e None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:44.626862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441a2b8-7d27-4f08-8756-460232d27077 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:44.649447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:44.676764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:44.712855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818ecdc-fa34-4553-ae00-abf1f77e91d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:44.715691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818ecdc-fa34-4553-ae00-abf1f77e91d8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.715987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818ecdc-fa34-4553-ae00-abf1f77e91d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.716274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818ecdc-fa34-4553-ae00-abf1f77e91d8 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.719020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818ecdc-fa34-4553-ae00-abf1f77e91d8 None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:44.721112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818ecdc-fa34-4553-ae00-abf1f77e91d8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:44.729500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 118/229] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:44 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:44.735901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818ecdc-fa34-4553-ae00-abf1f77e91d8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:44.835552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441a2b8-7d27-4f08-8756-460232d27077 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:44.879470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344d582-934d-446c-a9d0-696e23aa0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:44.880154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344d582-934d-446c-a9d0-696e23aa0719 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.880435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344d582-934d-446c-a9d0-696e23aa0719 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.880824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344d582-934d-446c-a9d0-696e23aa0719 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.881756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344d582-934d-446c-a9d0-696e23aa0719 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:44.882056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344d582-934d-446c-a9d0-696e23aa0719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:44.883444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344d582-934d-446c-a9d0-696e23aa0719 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:44.890938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818ecdc-fa34-4553-ae00-abf1f77e91d8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:44.895038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 112/230] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:44.900576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344d582-934d-446c-a9d0-696e23aa0719 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:44.965780 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd71c4-39dd-4197-a5d5-e6b696d9f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:44.966398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd71c4-39dd-4197-a5d5-e6b696d9f576 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:44.966683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd71c4-39dd-4197-a5d5-e6b696d9f576 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:44.966963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd71c4-39dd-4197-a5d5-e6b696d9f576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:44.967706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd71c4-39dd-4197-a5d5-e6b696d9f576 None admin] RBAC: Adding query filter params (role.id=d1bf17fdde744527bb5905634f0b1b2c, scope.project.id=c85373107052445eb6721136e8247abd, user.id=c9f64586d1a348649339ce1a3cf98a9a) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:44.968020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd71c4-39dd-4197-a5d5-e6b696d9f576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:44.973111 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd71c4-39dd-4197-a5d5-e6b696d9f576 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:44.987140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 119/231] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:44 2022] GET /identity/v3/role_assignments?user.id=c9f64586d1a348649339ce1a3cf98a9a&scope.project.id=c85373107052445eb6721136e8247abd&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:45.023550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:45.061957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344d582-934d-446c-a9d0-696e23aa0719 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:45.100619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b8df0-c000-4c40-9918-0516bace52bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:45.101262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8df0-c000-4c40-9918-0516bace52bb None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:45.101543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8df0-c000-4c40-9918-0516bace52bb None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:45.101869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8df0-c000-4c40-9918-0516bace52bb None admin] PATH_INFO: `/v3/users/314920a3226a4fb4b3474ef393b1e45a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:45.103078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b8df0-c000-4c40-9918-0516bace52bb None admin] RBAC: Authorizing `identity:get_user(user_id=314920a3226a4fb4b3474ef393b1e45a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:45.104611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b8df0-c000-4c40-9918-0516bace52bb None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:45.106555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 113/232] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:44 2022] GET /identity/v3/users/314920a3226a4fb4b3474ef393b1e45a => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:45.112316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd71c4-39dd-4197-a5d5-e6b696d9f576 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:45.187764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:45.271936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd71c4-39dd-4197-a5d5-e6b696d9f576 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:45.322073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546d6c6-2a4c-4a2d-b11b-c558c14c7a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:45.322713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546d6c6-2a4c-4a2d-b11b-c558c14c7a60 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:45.322990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546d6c6-2a4c-4a2d-b11b-c558c14c7a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:45.323263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546d6c6-2a4c-4a2d-b11b-c558c14c7a60 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:45.324397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546d6c6-2a4c-4a2d-b11b-c558c14c7a60 None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:45.325928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546d6c6-2a4c-4a2d-b11b-c558c14c7a60 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:45.327680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 120/233] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:45 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:45.334373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b8df0-c000-4c40-9918-0516bace52bb None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:45.457530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b8df0-c000-4c40-9918-0516bace52bb None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:45.524995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167606a0-0c5d-4c86-9d09-6de3916386ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:45.526284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167606a0-0c5d-4c86-9d09-6de3916386ca None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:45.526766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167606a0-0c5d-4c86-9d09-6de3916386ca None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:45.527377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167606a0-0c5d-4c86-9d09-6de3916386ca None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd/users/314920a3226a4fb4b3474ef393b1e45a/roles/3ba2e6e2ec814831bb3bc254484024d2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:45.530418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167606a0-0c5d-4c86-9d09-6de3916386ca None admin] RBAC: Authorizing `identity:create_grant(project_id=c85373107052445eb6721136e8247abd, user_id=314920a3226a4fb4b3474ef393b1e45a, role_id=3ba2e6e2ec814831bb3bc254484024d2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:45.532154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167606a0-0c5d-4c86-9d09-6de3916386ca None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:45.539033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:45.649333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 114/234] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:45 2022] PUT /identity/v3/projects/c85373107052445eb6721136e8247abd/users/314920a3226a4fb4b3474ef393b1e45a/roles/3ba2e6e2ec814831bb3bc254484024d2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:46.342574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f8902-61f7-4f14-95e1-6927024d17a3 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.343113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f8902-61f7-4f14-95e1-6927024d17a3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.343113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f8902-61f7-4f14-95e1-6927024d17a3 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.344590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 121/235] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:46.350244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb3ab6-2973-4147-a730-3442a7d14114 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.350638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb3ab6-2973-4147-a730-3442a7d14114 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.350802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb3ab6-2973-4147-a730-3442a7d14114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.379229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4cdb3ab6-2973-4147-a730-3442a7d14114 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:46.380501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4cdb3ab6-2973-4147-a730-3442a7d14114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:46.476380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 115/236] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:46.539520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6d5d4-33bd-4583-b8bf-1ad5413b866c None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.539862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6d5d4-33bd-4583-b8bf-1ad5413b866c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.540072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6d5d4-33bd-4583-b8bf-1ad5413b866c None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.541585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 122/237] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:46.547614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735e19-54bf-4ccb-bd05-82fab0f10fa6 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.548200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735e19-54bf-4ccb-bd05-82fab0f10fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.548673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735e19-54bf-4ccb-bd05-82fab0f10fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.567275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-32735e19-54bf-4ccb-bd05-82fab0f10fa6 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:46.568810 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-32735e19-54bf-4ccb-bd05-82fab0f10fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:46.650809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 116/238] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:46.769363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6d5d4-33bd-4583-b8bf-1ad5413b866c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:46.917403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6d5d4-33bd-4583-b8bf-1ad5413b866c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:46.943215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:46.963771 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ebeeb-7dee-40dd-bfc4-2784391d85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:46.964802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ebeeb-7dee-40dd-bfc4-2784391d85c0 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:46.965241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ebeeb-7dee-40dd-bfc4-2784391d85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:46.967434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ebeeb-7dee-40dd-bfc4-2784391d85c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:46.982213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ebeeb-7dee-40dd-bfc4-2784391d85c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-891ebeeb-7dee-40dd-bfc4-2784391d85c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:46.990281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:46.991807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:46.992573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 123/239] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:46.993211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32735e19-54bf-4ccb-bd05-82fab0f10fa6 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:47.000087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ebeeb-7dee-40dd-bfc4-2784391d85c0 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:47.104069 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:47.139602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ebeeb-7dee-40dd-bfc4-2784391d85c0 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.155750 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32735e19-54bf-4ccb-bd05-82fab0f10fa6 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.174333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba18c8c-5fb1-4b86-85c4-ed53c35d067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.174870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba18c8c-5fb1-4b86-85c4-ed53c35d067b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.175150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba18c8c-5fb1-4b86-85c4-ed53c35d067b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.175422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba18c8c-5fb1-4b86-85c4-ed53c35d067b None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.176101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba18c8c-5fb1-4b86-85c4-ed53c35d067b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:47.176402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba18c8c-5fb1-4b86-85c4-ed53c35d067b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:47.178044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba18c8c-5fb1-4b86-85c4-ed53c35d067b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:47.190720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 124/240] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:47.190720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6bb68-763e-4371-9e6e-6282e18add7d None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.190720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6bb68-763e-4371-9e6e-6282e18add7d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.190720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6bb68-763e-4371-9e6e-6282e18add7d None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.190720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 125/241] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:47.196997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef701d6c-ab12-4169-89e6-300aedabbb3e None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.197307 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef701d6c-ab12-4169-89e6-300aedabbb3e None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.197563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef701d6c-ab12-4169-89e6-300aedabbb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.205060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5fb83-a00e-4cf5-9deb-40cbe3da5f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.206199 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5fb83-a00e-4cf5-9deb-40cbe3da5f07 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.206682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5fb83-a00e-4cf5-9deb-40cbe3da5f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.207151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5fb83-a00e-4cf5-9deb-40cbe3da5f07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.209188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5fb83-a00e-4cf5-9deb-40cbe3da5f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:47.210885 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5fb83-a00e-4cf5-9deb-40cbe3da5f07 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:47.213167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 117/242] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:47.214243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5fb83-a00e-4cf5-9deb-40cbe3da5f07 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:47.221510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ef701d6c-ab12-4169-89e6-300aedabbb3e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:47.222810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ef701d6c-ab12-4169-89e6-300aedabbb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:47.262392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:47.295406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 126/243] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:47.303017 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef701d6c-ab12-4169-89e6-300aedabbb3e None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:47.332062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5fb83-a00e-4cf5-9deb-40cbe3da5f07 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.358415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:47.383679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb7c5-aa63-4556-8e2a-97e8318a096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.384687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb7c5-aa63-4556-8e2a-97e8318a096d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.385167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb7c5-aa63-4556-8e2a-97e8318a096d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.386655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cb7c5-aa63-4556-8e2a-97e8318a096d None admin] PATH_INFO: `/v3/users/e408088ee75748689b6af8c21ceb81d4` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.419350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cb7c5-aa63-4556-8e2a-97e8318a096d None admin] RBAC: Authorizing `identity:get_user(user_id=e408088ee75748689b6af8c21ceb81d4)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:47.421162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cb7c5-aa63-4556-8e2a-97e8318a096d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:47.423269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 118/244] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:47 2022] GET /identity/v3/users/e408088ee75748689b6af8c21ceb81d4 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:47.430038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb7c5-aa63-4556-8e2a-97e8318a096d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:47.440070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef701d6c-ab12-4169-89e6-300aedabbb3e None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.481043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807de13-1197-4ecf-92f0-3eb04b660b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.482064 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807de13-1197-4ecf-92f0-3eb04b660b72 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.482733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807de13-1197-4ecf-92f0-3eb04b660b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.483292 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807de13-1197-4ecf-92f0-3eb04b660b72 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.484148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807de13-1197-4ecf-92f0-3eb04b660b72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:47.485943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807de13-1197-4ecf-92f0-3eb04b660b72 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:47.552795 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 127/245] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:47 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:47.591847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cb7c5-aa63-4556-8e2a-97e8318a096d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.630561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f05f5-41a5-4798-9351-fe6cd6ee8a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.631184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f05f5-41a5-4798-9351-fe6cd6ee8a71 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.631460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f05f5-41a5-4798-9351-fe6cd6ee8a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.631731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f05f5-41a5-4798-9351-fe6cd6ee8a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.687720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:47.698921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ad07c-15c2-4aee-8d8e-066568c08db9 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.699217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ad07c-15c2-4aee-8d8e-066568c08db9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.699485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ad07c-15c2-4aee-8d8e-066568c08db9 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.700903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 128/246] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:47.706462 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01865026-ae6b-410a-b4a7-d97de6c43038 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.706753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01865026-ae6b-410a-b4a7-d97de6c43038 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.707738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01865026-ae6b-410a-b4a7-d97de6c43038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:47.708927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f05f5-41a5-4798-9351-fe6cd6ee8a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:47.710424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f05f5-41a5-4798-9351-fe6cd6ee8a71 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:47.738808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-01865026-ae6b-410a-b4a7-d97de6c43038 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:47.740661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-01865026-ae6b-410a-b4a7-d97de6c43038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:47.769352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:47.831258 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 129/247] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:47.832194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01865026-ae6b-410a-b4a7-d97de6c43038 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:47.852264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 119/248] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:07:47.854792 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f05f5-41a5-4798-9351-fe6cd6ee8a71 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:47.941679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:47.944161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01865026-ae6b-410a-b4a7-d97de6c43038 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.962939 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f05f5-41a5-4798-9351-fe6cd6ee8a71 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:47.986212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee06752-9c71-4968-970e-fc304aab9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:47.987205 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee06752-9c71-4968-970e-fc304aab9e75 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:47.987686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee06752-9c71-4968-970e-fc304aab9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:47.988130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee06752-9c71-4968-970e-fc304aab9e75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.000859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee06752-9c71-4968-970e-fc304aab9e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:48.003259 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e88f8f-c073-43b8-84db-ddf68118c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:48.003900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e88f8f-c073-43b8-84db-ddf68118c16f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.004186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e88f8f-c073-43b8-84db-ddf68118c16f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.004581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e88f8f-c073-43b8-84db-ddf68118c16f None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.005861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e88f8f-c073-43b8-84db-ddf68118c16f None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:48.007635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e88f8f-c073-43b8-84db-ddf68118c16f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-6ee06752-9c71-4968-970e-fc304aab9e75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:48.008171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:48.009001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:07:48.009826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:48.010424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 120/249] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:47 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:48.012432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 130/250] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:07:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:48.018244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e88f8f-c073-43b8-84db-ddf68118c16f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:48.018385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee06752-9c71-4968-970e-fc304aab9e75 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:48.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:48.128809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e88f8f-c073-43b8-84db-ddf68118c16f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:48.136960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee06752-9c71-4968-970e-fc304aab9e75 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:48.179201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56e483-a7d1-427e-a57d-282ec5e6fad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:48.179590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af456c1b-1310-4415-bda6-50b1ca7d2516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:48.180205 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af456c1b-1310-4415-bda6-50b1ca7d2516 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.180329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56e483-a7d1-427e-a57d-282ec5e6fad5 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.180487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af456c1b-1310-4415-bda6-50b1ca7d2516 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.180579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56e483-a7d1-427e-a57d-282ec5e6fad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.180756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af456c1b-1310-4415-bda6-50b1ca7d2516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.180862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56e483-a7d1-427e-a57d-282ec5e6fad5 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.181490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af456c1b-1310-4415-bda6-50b1ca7d2516 None admin] RBAC: Adding query filter params (role.id=d2ed58a85e7941fcadc0916d8c31fdb2, scope.project.id=c85373107052445eb6721136e8247abd, user.id=e408088ee75748689b6af8c21ceb81d4) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:48.181583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56e483-a7d1-427e-a57d-282ec5e6fad5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:48.181823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56e483-a7d1-427e-a57d-282ec5e6fad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:48.182952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af456c1b-1310-4415-bda6-50b1ca7d2516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:48.183190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56e483-a7d1-427e-a57d-282ec5e6fad5 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:48.184338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af456c1b-1310-4415-bda6-50b1ca7d2516 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:48.191020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 131/251] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:48 2022] GET /identity/v3/role_assignments?user.id=e408088ee75748689b6af8c21ceb81d4&scope.project.id=c85373107052445eb6721136e8247abd&role.id=d2ed58a85e7941fcadc0916d8c31fdb2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:48.192442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af456c1b-1310-4415-bda6-50b1ca7d2516 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:48.194676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 121/252] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:48.200636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56e483-a7d1-427e-a57d-282ec5e6fad5 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:48.220319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:48.310958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:48.329292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56e483-a7d1-427e-a57d-282ec5e6fad5 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:48.332254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af456c1b-1310-4415-bda6-50b1ca7d2516 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:48.368030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8762-5084-4b7d-a262-cc5ead2d8c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:48.368723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8762-5084-4b7d-a262-cc5ead2d8c2a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.369008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8762-5084-4b7d-a262-cc5ead2d8c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.369288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8762-5084-4b7d-a262-cc5ead2d8c2a None admin] PATH_INFO: `/v3/users/314920a3226a4fb4b3474ef393b1e45a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.371802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e8762-5084-4b7d-a262-cc5ead2d8c2a None admin] RBAC: Authorizing `identity:get_user(user_id=314920a3226a4fb4b3474ef393b1e45a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:48.373151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd318592-7218-4205-b128-5c1c187f6938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:48.373300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e8762-5084-4b7d-a262-cc5ead2d8c2a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:48.374162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd318592-7218-4205-b128-5c1c187f6938 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.374647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd318592-7218-4205-b128-5c1c187f6938 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.375118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd318592-7218-4205-b128-5c1c187f6938 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.375236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 122/253] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:48 2022] GET /identity/v3/users/314920a3226a4fb4b3474ef393b1e45a => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:48.381011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463070f-d3cb-4f36-9392-aa7f772f7f8a None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.381295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463070f-d3cb-4f36-9392-aa7f772f7f8a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.381575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463070f-d3cb-4f36-9392-aa7f772f7f8a None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.383001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 123/254] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:48.386083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463070f-d3cb-4f36-9392-aa7f772f7f8a None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:48.389286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd318592-7218-4205-b128-5c1c187f6938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-cd318592-7218-4205-b128-5c1c187f6938 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:48.394996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:48.395915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:48.396686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:48.399296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 132/255] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:48.400702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0d01-c766-4266-95d2-97d1347d5c6c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.401212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0d01-c766-4266-95d2-97d1347d5c6c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.401492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0d01-c766-4266-95d2-97d1347d5c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.426320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-1fcf0d01-c766-4266-95d2-97d1347d5c6c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:48.428430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1fcf0d01-c766-4266-95d2-97d1347d5c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:48.476806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:48.498186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 133/256] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:48.498801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463070f-d3cb-4f36-9392-aa7f772f7f8a None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:48.500593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf0d01-c766-4266-95d2-97d1347d5c6c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:48.540822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fb03e-9b12-4b60-8729-7cfe449502a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:48.540822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fb03e-9b12-4b60-8729-7cfe449502a3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.540822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fb03e-9b12-4b60-8729-7cfe449502a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.540822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fb03e-9b12-4b60-8729-7cfe449502a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.613366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fb03e-9b12-4b60-8729-7cfe449502a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:48.615579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fb03e-9b12-4b60-8729-7cfe449502a3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:48.645216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:48.654059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf0d01-c766-4266-95d2-97d1347d5c6c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:48.712596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:48.718461 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ff077-9ca1-4d38-95b4-8874bc7a519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:48.719284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ff077-9ca1-4d38-95b4-8874bc7a519a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.719781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ff077-9ca1-4d38-95b4-8874bc7a519a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.720185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ff077-9ca1-4d38-95b4-8874bc7a519a None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.724236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ff077-9ca1-4d38-95b4-8874bc7a519a None admin] RBAC: Adding query filter params (name=member) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:48.724236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ff077-9ca1-4d38-95b4-8874bc7a519a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:48.724236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ff077-9ca1-4d38-95b4-8874bc7a519a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:48.736173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 124/257] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:48.737118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 134/258] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:48.742961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fb03e-9b12-4b60-8729-7cfe449502a3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:48.743648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ff077-9ca1-4d38-95b4-8874bc7a519a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:48.896069 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fb03e-9b12-4b60-8729-7cfe449502a3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:48.934861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ababd0-e122-4511-92f8-8e742af6569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:48.935504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ababd0-e122-4511-92f8-8e742af6569e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:48.935783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ababd0-e122-4511-92f8-8e742af6569e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:48.936053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ababd0-e122-4511-92f8-8e742af6569e None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:48.938574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ababd0-e122-4511-92f8-8e742af6569e None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:48.940504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ababd0-e122-4511-92f8-8e742af6569e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:48.942841 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 125/259] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:48 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:48.954773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ababd0-e122-4511-92f8-8e742af6569e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:48.957337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ff077-9ca1-4d38-95b4-8874bc7a519a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.026126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ed7a1-af49-4513-b20d-b71e5a67232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.026773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ed7a1-af49-4513-b20d-b71e5a67232a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.027055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ed7a1-af49-4513-b20d-b71e5a67232a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.027330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ed7a1-af49-4513-b20d-b71e5a67232a None admin] PATH_INFO: `/v3/users/c9f64586d1a348649339ce1a3cf98a9a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.028481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ed7a1-af49-4513-b20d-b71e5a67232a None admin] RBAC: Authorizing `identity:get_user(user_id=c9f64586d1a348649339ce1a3cf98a9a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:49.029956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ed7a1-af49-4513-b20d-b71e5a67232a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:49.031861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 135/260] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:48 2022] GET /identity/v3/users/c9f64586d1a348649339ce1a3cf98a9a => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:49.032813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ed7a1-af49-4513-b20d-b71e5a67232a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.043691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:49.069419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:49.166300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ababd0-e122-4511-92f8-8e742af6569e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.206484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922dd41-efd9-47b2-b3c1-211df7c42be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.207389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dd41-efd9-47b2-b3c1-211df7c42be6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.207882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dd41-efd9-47b2-b3c1-211df7c42be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.208908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dd41-efd9-47b2-b3c1-211df7c42be6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.209808 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922dd41-efd9-47b2-b3c1-211df7c42be6 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=c85373107052445eb6721136e8247abd, user.id=314920a3226a4fb4b3474ef393b1e45a) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:49.210308 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922dd41-efd9-47b2-b3c1-211df7c42be6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:49.211989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922dd41-efd9-47b2-b3c1-211df7c42be6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:49.218769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 126/261] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:48 2022] GET /identity/v3/role_assignments?user.id=314920a3226a4fb4b3474ef393b1e45a&scope.project.id=c85373107052445eb6721136e8247abd&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:49.219840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922dd41-efd9-47b2-b3c1-211df7c42be6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.291907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ed7a1-af49-4513-b20d-b71e5a67232a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.339349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922dd41-efd9-47b2-b3c1-211df7c42be6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.362261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:49.378017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d0020-e92d-40d3-bf79-2d59a4ad381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.379466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0020-e92d-40d3-bf79-2d59a4ad381a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.379935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0020-e92d-40d3-bf79-2d59a4ad381a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.380361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d0020-e92d-40d3-bf79-2d59a4ad381a None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.381750 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d0020-e92d-40d3-bf79-2d59a4ad381a None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:49.383683 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d0020-e92d-40d3-bf79-2d59a4ad381a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:49.385635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 127/262] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:49.391233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d0020-e92d-40d3-bf79-2d59a4ad381a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.405909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff8165-3fd7-4049-9689-4caf0c26420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.406981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff8165-3fd7-4049-9689-4caf0c26420f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.407481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff8165-3fd7-4049-9689-4caf0c26420f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.407973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff8165-3fd7-4049-9689-4caf0c26420f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.435273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff8165-3fd7-4049-9689-4caf0c26420f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-58ff8165-3fd7-4049-9689-4caf0c26420f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:49.445611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:49.446574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:07:49.447362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:49.454067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 136/263] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:49.471615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff8165-3fd7-4049-9689-4caf0c26420f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.578417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:49.590259 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d0020-e92d-40d3-bf79-2d59a4ad381a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.630833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff8165-3fd7-4049-9689-4caf0c26420f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.643209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d84ea1-a8c0-4a4e-ab36-39445707ddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.644286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d84ea1-a8c0-4a4e-ab36-39445707ddcd None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.644833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d84ea1-a8c0-4a4e-ab36-39445707ddcd None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.645312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d84ea1-a8c0-4a4e-ab36-39445707ddcd None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd/users/c9f64586d1a348649339ce1a3cf98a9a/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.649326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d84ea1-a8c0-4a4e-ab36-39445707ddcd None admin] RBAC: Authorizing `identity:create_grant(project_id=c85373107052445eb6721136e8247abd, user_id=c9f64586d1a348649339ce1a3cf98a9a, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:49.651961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d84ea1-a8c0-4a4e-ab36-39445707ddcd None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:49.684187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c0dbe-1191-4102-969d-79882560ac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.685156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c0dbe-1191-4102-969d-79882560ac5c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.685651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c0dbe-1191-4102-969d-79882560ac5c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.686158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c0dbe-1191-4102-969d-79882560ac5c None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.687076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c0dbe-1191-4102-969d-79882560ac5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:49.687585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c0dbe-1191-4102-969d-79882560ac5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:49.689302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c0dbe-1191-4102-969d-79882560ac5c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:49.699835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 137/264] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:49.708699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c0dbe-1191-4102-969d-79882560ac5c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.713382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 128/265] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:49 2022] PUT /identity/v3/projects/c85373107052445eb6721136e8247abd/users/c9f64586d1a348649339ce1a3cf98a9a/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:07:49.847547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c0dbe-1191-4102-969d-79882560ac5c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:49.877961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:49.892978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ead4e4-8737-4461-8b5d-7efe2effb4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:49.894109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ead4e4-8737-4461-8b5d-7efe2effb4ac None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:49.894598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ead4e4-8737-4461-8b5d-7efe2effb4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:49.895124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ead4e4-8737-4461-8b5d-7efe2effb4ac None admin] PATH_INFO: `/v3/users/314920a3226a4fb4b3474ef393b1e45a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:49.897960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ead4e4-8737-4461-8b5d-7efe2effb4ac None admin] RBAC: Authorizing `identity:get_user(user_id=314920a3226a4fb4b3474ef393b1e45a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:49.899797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ead4e4-8737-4461-8b5d-7efe2effb4ac None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:49.902148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 138/266] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/users/314920a3226a4fb4b3474ef393b1e45a => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:49.908195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d84ea1-a8c0-4a4e-ab36-39445707ddcd None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:49.959324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.031850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d84ea1-a8c0-4a4e-ab36-39445707ddcd None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.074200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e7fe9-b748-452c-8b72-60fe15a2bbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.074828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e7fe9-b748-452c-8b72-60fe15a2bbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.075113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e7fe9-b748-452c-8b72-60fe15a2bbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.075389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e7fe9-b748-452c-8b72-60fe15a2bbd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.150515 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e7fe9-b748-452c-8b72-60fe15a2bbd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.151968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e7fe9-b748-452c-8b72-60fe15a2bbd4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.196340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.267127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 129/267] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:50.273516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ead4e4-8737-4461-8b5d-7efe2effb4ac None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.395981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ead4e4-8737-4461-8b5d-7efe2effb4ac None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.441827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c593a9-b135-4a9b-b567-d2d7a41f8891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.442526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c593a9-b135-4a9b-b567-d2d7a41f8891 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.442812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c593a9-b135-4a9b-b567-d2d7a41f8891 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.443090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c593a9-b135-4a9b-b567-d2d7a41f8891 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.444292 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c593a9-b135-4a9b-b567-d2d7a41f8891 None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.446046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c593a9-b135-4a9b-b567-d2d7a41f8891 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.447801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 139/268] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:50.453645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e7fe9-b748-452c-8b72-60fe15a2bbd4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.573910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e7fe9-b748-452c-8b72-60fe15a2bbd4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.621796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16621b-5c93-4272-b97a-3fe6d514754c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.622421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16621b-5c93-4272-b97a-3fe6d514754c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.622703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16621b-5c93-4272-b97a-3fe6d514754c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.622976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16621b-5c93-4272-b97a-3fe6d514754c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.623722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16621b-5c93-4272-b97a-3fe6d514754c None admin] RBAC: Adding query filter params (role.id=3ba2e6e2ec814831bb3bc254484024d2, scope.project.id=c85373107052445eb6721136e8247abd, user.id=314920a3226a4fb4b3474ef393b1e45a) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:50.624033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16621b-5c93-4272-b97a-3fe6d514754c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.625560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16621b-5c93-4272-b97a-3fe6d514754c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.636009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 130/269] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/role_assignments?user.id=314920a3226a4fb4b3474ef393b1e45a&scope.project.id=c85373107052445eb6721136e8247abd&role.id=3ba2e6e2ec814831bb3bc254484024d2 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:50.638941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e0760-a973-40dc-9f20-5d99d8e84cb1 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.639370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e0760-a973-40dc-9f20-5d99d8e84cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.639531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e0760-a973-40dc-9f20-5d99d8e84cb1 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.640984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 140/270] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:50.653738 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f22d-616b-4d8f-a590-d191ad65f1e0 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.654051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f22d-616b-4d8f-a590-d191ad65f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.654302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f22d-616b-4d8f-a590-d191ad65f1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.666493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.681464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c551f22d-616b-4d8f-a590-d191ad65f1e0 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:50.682807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c551f22d-616b-4d8f-a590-d191ad65f1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:50.750167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c3ffd-d956-40e7-ac9f-78999c3700aa None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.750452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c3ffd-d956-40e7-ac9f-78999c3700aa None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.750645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c3ffd-d956-40e7-ac9f-78999c3700aa None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.752353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 141/271] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:50.760282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71cb88-0202-45fb-9e13-c55528536f0c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.760627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71cb88-0202-45fb-9e13-c55528536f0c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.760840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71cb88-0202-45fb-9e13-c55528536f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.767026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 131/272] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:50.781874 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-dc71cb88-0202-45fb-9e13-c55528536f0c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:50.783213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-dc71cb88-0202-45fb-9e13-c55528536f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:50.856074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.868462 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 142/273] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:50.919649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e077-fd54-4f60-8b20-a059a744a5ab None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.919649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e077-fd54-4f60-8b20-a059a744a5ab None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.919649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e077-fd54-4f60-8b20-a059a744a5ab None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.919649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 132/274] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:50.925208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe43c3-a4db-4d76-a647-3a5852ba5778 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.925493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe43c3-a4db-4d76-a647-3a5852ba5778 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.925824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe43c3-a4db-4d76-a647-3a5852ba5778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.950183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b7fe43c3-a4db-4d76-a647-3a5852ba5778 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:50.951742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b7fe43c3-a4db-4d76-a647-3a5852ba5778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:51.037655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 143/275] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:51.094660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e077-fd54-4f60-8b20-a059a744a5ab None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.184847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe43c3-a4db-4d76-a647-3a5852ba5778 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.215840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e077-fd54-4f60-8b20-a059a744a5ab None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.251568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69086205-80bf-4f3b-bc88-de45748b9c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.252541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69086205-80bf-4f3b-bc88-de45748b9c68 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.253044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69086205-80bf-4f3b-bc88-de45748b9c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.253538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69086205-80bf-4f3b-bc88-de45748b9c68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.257564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.269889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69086205-80bf-4f3b-bc88-de45748b9c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-69086205-80bf-4f3b-bc88-de45748b9c68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:51.274877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:51.275832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:51.277375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 133/276] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:51.282236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69086205-80bf-4f3b-bc88-de45748b9c68 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.322307 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe43c3-a4db-4d76-a647-3a5852ba5778 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.343912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.359454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdfb4a-6925-4e08-b450-f4d99c096fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.360097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdfb4a-6925-4e08-b450-f4d99c096fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.360373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdfb4a-6925-4e08-b450-f4d99c096fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.360643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdfb4a-6925-4e08-b450-f4d99c096fc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.361779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdfb4a-6925-4e08-b450-f4d99c096fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.363243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdfb4a-6925-4e08-b450-f4d99c096fc7 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.365366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 144/277] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:51.366158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdfb4a-6925-4e08-b450-f4d99c096fc7 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.398583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69086205-80bf-4f3b-bc88-de45748b9c68 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.435618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6de042-8a2b-4831-ae97-07f02d92fc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.436461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6de042-8a2b-4831-ae97-07f02d92fc36 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.436880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6de042-8a2b-4831-ae97-07f02d92fc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.437392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6de042-8a2b-4831-ae97-07f02d92fc36 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.438357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6de042-8a2b-4831-ae97-07f02d92fc36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:51.438658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6de042-8a2b-4831-ae97-07f02d92fc36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.440072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6de042-8a2b-4831-ae97-07f02d92fc36 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.455661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 134/278] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:51.456834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6de042-8a2b-4831-ae97-07f02d92fc36 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.470349 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdfb4a-6925-4e08-b450-f4d99c096fc7 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.505346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000b2a-c0be-4dae-83ce-fd69d6628f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.506005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000b2a-c0be-4dae-83ce-fd69d6628f8c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.506289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000b2a-c0be-4dae-83ce-fd69d6628f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.506617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000b2a-c0be-4dae-83ce-fd69d6628f8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.518233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f000b2a-c0be-4dae-83ce-fd69d6628f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:51.518744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-8f000b2a-c0be-4dae-83ce-fd69d6628f8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:51.523869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:51.524753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:51.525565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 145/279] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:51.527145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000b2a-c0be-4dae-83ce-fd69d6628f8c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.572585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6de042-8a2b-4831-ae97-07f02d92fc36 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.586948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.607344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece139-5429-489c-ba99-0c04988a4938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.608027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece139-5429-489c-ba99-0c04988a4938 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.608585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece139-5429-489c-ba99-0c04988a4938 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.608771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece139-5429-489c-ba99-0c04988a4938 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.609426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ece139-5429-489c-ba99-0c04988a4938 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.610952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ece139-5429-489c-ba99-0c04988a4938 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.643518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000b2a-c0be-4dae-83ce-fd69d6628f8c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.676353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270ef97-f66a-4f4a-8b69-d73da0df71f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.677551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270ef97-f66a-4f4a-8b69-d73da0df71f4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.677853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270ef97-f66a-4f4a-8b69-d73da0df71f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.678129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270ef97-f66a-4f4a-8b69-d73da0df71f4 None admin] PATH_INFO: `/v3/users/e408088ee75748689b6af8c21ceb81d4` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.679242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270ef97-f66a-4f4a-8b69-d73da0df71f4 None admin] RBAC: Authorizing `identity:get_user(user_id=e408088ee75748689b6af8c21ceb81d4)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.680675 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270ef97-f66a-4f4a-8b69-d73da0df71f4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.682271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 146/280] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/users/e408088ee75748689b6af8c21ceb81d4 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:51.682271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270ef97-f66a-4f4a-8b69-d73da0df71f4 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.724398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 135/281] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:51 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:51.725654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece139-5429-489c-ba99-0c04988a4938 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.828973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270ef97-f66a-4f4a-8b69-d73da0df71f4 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.854113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.868943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece139-5429-489c-ba99-0c04988a4938 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.880255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18792ed-02c6-4547-b693-199faa02656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.881586 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18792ed-02c6-4547-b693-199faa02656d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.882040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18792ed-02c6-4547-b693-199faa02656d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.882752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18792ed-02c6-4547-b693-199faa02656d None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.883647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18792ed-02c6-4547-b693-199faa02656d None admin] RBAC: Adding query filter params (name=member) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:51.884524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.884778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18792ed-02c6-4547-b693-199faa02656d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.887633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18792ed-02c6-4547-b693-199faa02656d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.900980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 147/282] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:51.906309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18792ed-02c6-4547-b693-199faa02656d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.914387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae60e5-3d3a-482a-9350-c89d975f162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.915115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae60e5-3d3a-482a-9350-c89d975f162f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.915464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae60e5-3d3a-482a-9350-c89d975f162f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.915831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae60e5-3d3a-482a-9350-c89d975f162f None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.917063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae60e5-3d3a-482a-9350-c89d975f162f None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.918603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae60e5-3d3a-482a-9350-c89d975f162f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.920379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 136/283] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:51.927379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae60e5-3d3a-482a-9350-c89d975f162f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.046156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18792ed-02c6-4547-b693-199faa02656d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.075608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae60e5-3d3a-482a-9350-c89d975f162f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.089802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0744bd-a7ad-4a88-9fa2-4fc51011dbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.091033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0744bd-a7ad-4a88-9fa2-4fc51011dbfe None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.091496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0744bd-a7ad-4a88-9fa2-4fc51011dbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.091889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0744bd-a7ad-4a88-9fa2-4fc51011dbfe None admin] PATH_INFO: `/v3/users/39e0911537e54191bb8c5f69be781fae` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.114290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0744bd-a7ad-4a88-9fa2-4fc51011dbfe None admin] RBAC: Authorizing `identity:get_user(user_id=39e0911537e54191bb8c5f69be781fae)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.115818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0744bd-a7ad-4a88-9fa2-4fc51011dbfe None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.118536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 148/284] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:51 2022] GET /identity/v3/users/39e0911537e54191bb8c5f69be781fae => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:52.125322 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0744bd-a7ad-4a88-9fa2-4fc51011dbfe None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.127583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8dc60-c2f0-47c5-a45a-dfd934b7bf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.128627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8dc60-c2f0-47c5-a45a-dfd934b7bf9d None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.128909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8dc60-c2f0-47c5-a45a-dfd934b7bf9d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.129849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8dc60-c2f0-47c5-a45a-dfd934b7bf9d None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd/users/e408088ee75748689b6af8c21ceb81d4/roles/d2ed58a85e7941fcadc0916d8c31fdb2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.132633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8dc60-c2f0-47c5-a45a-dfd934b7bf9d None admin] RBAC: Authorizing `identity:create_grant(project_id=c85373107052445eb6721136e8247abd, user_id=e408088ee75748689b6af8c21ceb81d4, role_id=d2ed58a85e7941fcadc0916d8c31fdb2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.135096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8dc60-c2f0-47c5-a45a-dfd934b7bf9d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.166933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:52.219377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 137/285] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:07:51 2022] PUT /identity/v3/projects/c85373107052445eb6721136e8247abd/users/e408088ee75748689b6af8c21ceb81d4/roles/d2ed58a85e7941fcadc0916d8c31fdb2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:07:52.256669 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0744bd-a7ad-4a88-9fa2-4fc51011dbfe None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.306017 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dd887-485a-4852-bbf2-b892f3ab29ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.306631 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dd887-485a-4852-bbf2-b892f3ab29ee None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.306904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dd887-485a-4852-bbf2-b892f3ab29ee None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.307173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dd887-485a-4852-bbf2-b892f3ab29ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.307909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dd887-485a-4852-bbf2-b892f3ab29ee None admin] RBAC: Adding query filter params (role.id=d1bf17fdde744527bb5905634f0b1b2c, user.id=39e0911537e54191bb8c5f69be781fae, scope.system=all) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:52.308212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dd887-485a-4852-bbf2-b892f3ab29ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:52.309638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dd887-485a-4852-bbf2-b892f3ab29ee None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:52.318366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 149/286] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 31 19:07:52 2022] GET /identity/v3/role_assignments?user.id=39e0911537e54191bb8c5f69be781fae&scope.system=all&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:52.370682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11e6f-61a0-4f3b-a9f7-98c63727b620 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.370984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11e6f-61a0-4f3b-a9f7-98c63727b620 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.371145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11e6f-61a0-4f3b-a9f7-98c63727b620 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.372646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 138/287] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:52.378513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad89f0-2298-4f54-af9b-2cde97d46540 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.378834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad89f0-2298-4f54-af9b-2cde97d46540 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.379062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad89f0-2298-4f54-af9b-2cde97d46540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.406914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a7ad89f0-2298-4f54-af9b-2cde97d46540 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:52.408154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a7ad89f0-2298-4f54-af9b-2cde97d46540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:52.506261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 150/288] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:52.805249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f11e6f-61a0-4f3b-a9f7-98c63727b620 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:52.875883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:52.946680 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f11e6f-61a0-4f3b-a9f7-98c63727b620 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:52.982305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225766da-d4e2-4eb5-98d2-808ee4bb0e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:52.982944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225766da-d4e2-4eb5-98d2-808ee4bb0e0f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:52.983225 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225766da-d4e2-4eb5-98d2-808ee4bb0e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:52.983499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225766da-d4e2-4eb5-98d2-808ee4bb0e0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:52.994739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225766da-d4e2-4eb5-98d2-808ee4bb0e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-225766da-d4e2-4eb5-98d2-808ee4bb0e0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:53.000227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:53.003891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:53.004692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 139/289] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:53.007480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad89f0-2298-4f54-af9b-2cde97d46540 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.039300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.117608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad89f0-2298-4f54-af9b-2cde97d46540 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.162847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410930-2daf-48f6-b2b9-bd4f867d85a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.163470 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410930-2daf-48f6-b2b9-bd4f867d85a2 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.163757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410930-2daf-48f6-b2b9-bd4f867d85a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.164034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410930-2daf-48f6-b2b9-bd4f867d85a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.164718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a410930-2daf-48f6-b2b9-bd4f867d85a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:53.165024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a410930-2daf-48f6-b2b9-bd4f867d85a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.166429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a410930-2daf-48f6-b2b9-bd4f867d85a2 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.178904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 151/290] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:53.184407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225766da-d4e2-4eb5-98d2-808ee4bb0e0f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.293659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.301983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225766da-d4e2-4eb5-98d2-808ee4bb0e0f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.343302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1043f-a086-42b1-87c4-81c71fa369ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.343963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1043f-a086-42b1-87c4-81c71fa369ae None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.344243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1043f-a086-42b1-87c4-81c71fa369ae None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.344517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1043f-a086-42b1-87c4-81c71fa369ae None admin] PATH_INFO: `/v3/users/c9f64586d1a348649339ce1a3cf98a9a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.345693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1043f-a086-42b1-87c4-81c71fa369ae None admin] RBAC: Authorizing `identity:get_user(user_id=c9f64586d1a348649339ce1a3cf98a9a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.347129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1043f-a086-42b1-87c4-81c71fa369ae None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.349328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 140/291] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/users/c9f64586d1a348649339ce1a3cf98a9a => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:53.355153 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410930-2daf-48f6-b2b9-bd4f867d85a2 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.505166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.514228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410930-2daf-48f6-b2b9-bd4f867d85a2 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.554770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8305-a005-4f97-99ea-0bfd7bf386d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.555380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8305-a005-4f97-99ea-0bfd7bf386d8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.555665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8305-a005-4f97-99ea-0bfd7bf386d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.555942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8305-a005-4f97-99ea-0bfd7bf386d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.629048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb8305-a005-4f97-99ea-0bfd7bf386d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.630590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb8305-a005-4f97-99ea-0bfd7bf386d8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.761257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:53.771445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 152/292] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:07:53.777278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1043f-a086-42b1-87c4-81c71fa369ae None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:53.918484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1043f-a086-42b1-87c4-81c71fa369ae None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:53.954598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5658ec-0822-42e4-854e-10e256cd213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:53.955241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5658ec-0822-42e4-854e-10e256cd213c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.955523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5658ec-0822-42e4-854e-10e256cd213c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.955796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5658ec-0822-42e4-854e-10e256cd213c None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.956967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5658ec-0822-42e4-854e-10e256cd213c None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:53.958998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5658ec-0822-42e4-854e-10e256cd213c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:53.961031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 141/293] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:53.966589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8305-a005-4f97-99ea-0bfd7bf386d8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.115777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8305-a005-4f97-99ea-0bfd7bf386d8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.168839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606b03-f6fa-4f65-927f-e77c9c2ce2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.169462 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606b03-f6fa-4f65-927f-e77c9c2ce2cf None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.169779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606b03-f6fa-4f65-927f-e77c9c2ce2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.170061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606b03-f6fa-4f65-927f-e77c9c2ce2cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.170801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606b03-f6fa-4f65-927f-e77c9c2ce2cf None admin] RBAC: Adding query filter params (role.id=d1bf17fdde744527bb5905634f0b1b2c, scope.project.id=c85373107052445eb6721136e8247abd, user.id=c9f64586d1a348649339ce1a3cf98a9a) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:54.171113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606b03-f6fa-4f65-927f-e77c9c2ce2cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.172570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606b03-f6fa-4f65-927f-e77c9c2ce2cf None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.180213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 153/294] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/role_assignments?user.id=c9f64586d1a348649339ce1a3cf98a9a&scope.project.id=c85373107052445eb6721136e8247abd&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:54.319774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c5525-1135-44a6-a3a2-418d51bc7dc8 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.320527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c5525-1135-44a6-a3a2-418d51bc7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.320967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c5525-1135-44a6-a3a2-418d51bc7dc8 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.322814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 142/295] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:54.328342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda854ff-40d5-4bde-921e-dc42c19ce1f0 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.328690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda854ff-40d5-4bde-921e-dc42c19ce1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.328979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda854ff-40d5-4bde-921e-dc42c19ce1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.354367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-cda854ff-40d5-4bde-921e-dc42c19ce1f0 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:54.355591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-cda854ff-40d5-4bde-921e-dc42c19ce1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:54.422514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.443977 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f04f-e54f-4167-9205-30d33da0f3d8 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.444271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f04f-e54f-4167-9205-30d33da0f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.444535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f04f-e54f-4167-9205-30d33da0f3d8 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.445767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 154/296] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:54.446340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 143/297] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:54.452336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10383d-caa9-488c-ac2d-1ddd3b963fc3 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.452618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10383d-caa9-488c-ac2d-1ddd3b963fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.452896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10383d-caa9-488c-ac2d-1ddd3b963fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.476507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-3a10383d-caa9-488c-ac2d-1ddd3b963fc3 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:54.478025 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3a10383d-caa9-488c-ac2d-1ddd3b963fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:54.519153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.572039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 144/298] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:54.735739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda854ff-40d5-4bde-921e-dc42c19ce1f0 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.847837 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda854ff-40d5-4bde-921e-dc42c19ce1f0 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.870764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee826e-cc84-4343-9ed1-4fbe227f76de None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.871091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee826e-cc84-4343-9ed1-4fbe227f76de None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.871308 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee826e-cc84-4343-9ed1-4fbe227f76de None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.872763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 145/299] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:54.878086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db98ef3-99bd-416e-83ea-095f5b8780ea None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.878363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db98ef3-99bd-416e-83ea-095f5b8780ea None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.878632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db98ef3-99bd-416e-83ea-095f5b8780ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.891217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee808b7-a810-44ce-bad9-0a70fc288223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.891857 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee808b7-a810-44ce-bad9-0a70fc288223 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.892138 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee808b7-a810-44ce-bad9-0a70fc288223 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.892413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee808b7-a810-44ce-bad9-0a70fc288223 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.898275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5db98ef3-99bd-416e-83ea-095f5b8780ea None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:54.899452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5db98ef3-99bd-416e-83ea-095f5b8780ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:54.903222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee808b7-a810-44ce-bad9-0a70fc288223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-cee808b7-a810-44ce-bad9-0a70fc288223 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:54.908131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:54.909008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:07:54.909825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 155/300] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:54.910460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee808b7-a810-44ce-bad9-0a70fc288223 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.959271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.968529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 146/301] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:54.969922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5d276-e85d-4573-b4d7-e2a7166173c4 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.970210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5d276-e85d-4573-b4d7-e2a7166173c4 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.970483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5d276-e85d-4573-b4d7-e2a7166173c4 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.971728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 147/302] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:54.974795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5d276-e85d-4573-b4d7-e2a7166173c4 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.015543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee808b7-a810-44ce-bad9-0a70fc288223 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.049397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d263b-7b47-4e5d-b39d-58a08046b7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.050058 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d263b-7b47-4e5d-b39d-58a08046b7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.050342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d263b-7b47-4e5d-b39d-58a08046b7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.050617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d263b-7b47-4e5d-b39d-58a08046b7a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.051763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d263b-7b47-4e5d-b39d-58a08046b7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.053200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d263b-7b47-4e5d-b39d-58a08046b7a5 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.059360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 156/303] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:55.059360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5efb75-9aad-44b2-b1ea-5f18db51f935 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.059360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5efb75-9aad-44b2-b1ea-5f18db51f935 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.059360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5efb75-9aad-44b2-b1ea-5f18db51f935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.077558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-2f5efb75-9aad-44b2-b1ea-5f18db51f935 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:55.078785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2f5efb75-9aad-44b2-b1ea-5f18db51f935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:55.117865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.124587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5d276-e85d-4573-b4d7-e2a7166173c4 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.153197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 157/304] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:55.154574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5efb75-9aad-44b2-b1ea-5f18db51f935 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.172226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a74da9-11a5-4eaa-815b-0c8cd3e47b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.172976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a74da9-11a5-4eaa-815b-0c8cd3e47b23 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.173635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a74da9-11a5-4eaa-815b-0c8cd3e47b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.174032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a74da9-11a5-4eaa-815b-0c8cd3e47b23 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.175281 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a74da9-11a5-4eaa-815b-0c8cd3e47b23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:55.175713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a74da9-11a5-4eaa-815b-0c8cd3e47b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.177278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a74da9-11a5-4eaa-815b-0c8cd3e47b23 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.189442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 148/305] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:55.197213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a74da9-11a5-4eaa-815b-0c8cd3e47b23 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.213839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.277122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5efb75-9aad-44b2-b1ea-5f18db51f935 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.303252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a74da9-11a5-4eaa-815b-0c8cd3e47b23 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.313838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4043b4-eb87-4c10-bbce-4a8b95964729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.314772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4043b4-eb87-4c10-bbce-4a8b95964729 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.315201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4043b4-eb87-4c10-bbce-4a8b95964729 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.315482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4043b4-eb87-4c10-bbce-4a8b95964729 None admin] PATH_INFO: `/v3/groups` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.316120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4043b4-eb87-4c10-bbce-4a8b95964729 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.317589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4043b4-eb87-4c10-bbce-4a8b95964729 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.337554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5acfe-7743-4838-8241-1bbf474ce859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.338213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5acfe-7743-4838-8241-1bbf474ce859 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.338497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5acfe-7743-4838-8241-1bbf474ce859 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.338890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5acfe-7743-4838-8241-1bbf474ce859 None admin] PATH_INFO: `/v3/users/9d8166a67ec04d6a9d73041c9cc55f80` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.352313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5acfe-7743-4838-8241-1bbf474ce859 None admin] RBAC: Authorizing `identity:get_user(user_id=9d8166a67ec04d6a9d73041c9cc55f80)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.353824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5acfe-7743-4838-8241-1bbf474ce859 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.355417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 149/306] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/users/9d8166a67ec04d6a9d73041c9cc55f80 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:55.360335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5acfe-7743-4838-8241-1bbf474ce859 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.374042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.396639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 158/307] 10.222.0.42 () {60 vars in 1134 bytes} [Wed Aug 31 19:07:55 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:55.396639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4043b4-eb87-4c10-bbce-4a8b95964729 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.482269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5acfe-7743-4838-8241-1bbf474ce859 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.521169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f5883-811a-4794-849a-e63d92471ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.523908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f5883-811a-4794-849a-e63d92471ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.523908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f5883-811a-4794-849a-e63d92471ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.523908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f5883-811a-4794-849a-e63d92471ba8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.524329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4043b4-eb87-4c10-bbce-4a8b95964729 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.526491 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.540101 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f5883-811a-4794-849a-e63d92471ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-3c9f5883-811a-4794-849a-e63d92471ba8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:55.540764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:55.541793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:55.542869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 150/308] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:55.543750 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f5883-811a-4794-849a-e63d92471ba8 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.568387 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424fe1-20d5-41f4-a119-a87bddf2413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.569388 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424fe1-20d5-41f4-a119-a87bddf2413c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.569698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424fe1-20d5-41f4-a119-a87bddf2413c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.570056 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424fe1-20d5-41f4-a119-a87bddf2413c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.571055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54424fe1-20d5-41f4-a119-a87bddf2413c None admin] RBAC: Adding query filter params (role.id=d2ed58a85e7941fcadc0916d8c31fdb2, user.id=9d8166a67ec04d6a9d73041c9cc55f80, scope.system=all) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:55.571372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54424fe1-20d5-41f4-a119-a87bddf2413c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.572815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54424fe1-20d5-41f4-a119-a87bddf2413c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.581736 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 159/309] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/role_assignments?user.id=9d8166a67ec04d6a9d73041c9cc55f80&scope.system=all&role.id=d2ed58a85e7941fcadc0916d8c31fdb2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:55.583201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424fe1-20d5-41f4-a119-a87bddf2413c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.640260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.667463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f5883-811a-4794-849a-e63d92471ba8 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.719889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95d0a8-6530-4936-ac56-528f345eea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.720714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95d0a8-6530-4936-ac56-528f345eea27 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.721212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95d0a8-6530-4936-ac56-528f345eea27 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.721589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95d0a8-6530-4936-ac56-528f345eea27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.737648 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95d0a8-6530-4936-ac56-528f345eea27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:55.743073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424fe1-20d5-41f4-a119-a87bddf2413c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-4b95d0a8-6530-4936-ac56-528f345eea27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:55.743247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:55.744074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:55.744856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 151/310] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:55.750206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95d0a8-6530-4936-ac56-528f345eea27 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.795693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0a91-94dc-47dc-9f25-317089196804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.796748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0a91-94dc-47dc-9f25-317089196804 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.797312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0a91-94dc-47dc-9f25-317089196804 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.797830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0a91-94dc-47dc-9f25-317089196804 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.798860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab0a91-94dc-47dc-9f25-317089196804 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:55.799375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab0a91-94dc-47dc-9f25-317089196804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.801062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab0a91-94dc-47dc-9f25-317089196804 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.820048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 160/311] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:55.822484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0a91-94dc-47dc-9f25-317089196804 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.862185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95d0a8-6530-4936-ac56-528f345eea27 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.863682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.900178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284ce7-15b3-4d26-b5a1-8d00da05219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.900549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284ce7-15b3-4d26-b5a1-8d00da05219f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.900806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284ce7-15b3-4d26-b5a1-8d00da05219f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.901081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284ce7-15b3-4d26-b5a1-8d00da05219f None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.901940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5284ce7-15b3-4d26-b5a1-8d00da05219f None admin] RBAC: Adding query filter params (name=member) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:55.902244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5284ce7-15b3-4d26-b5a1-8d00da05219f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.903832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5284ce7-15b3-4d26-b5a1-8d00da05219f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.910063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.914383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 152/312] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:55.920258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284ce7-15b3-4d26-b5a1-8d00da05219f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.958589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0a91-94dc-47dc-9f25-317089196804 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.012152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ad58f-f70c-4d04-a438-7d4a2fcbf7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.012877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ad58f-f70c-4d04-a438-7d4a2fcbf7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.013164 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ad58f-f70c-4d04-a438-7d4a2fcbf7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.013442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ad58f-f70c-4d04-a438-7d4a2fcbf7b9 None admin] PATH_INFO: `/v3/users/e408088ee75748689b6af8c21ceb81d4` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.014772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ad58f-f70c-4d04-a438-7d4a2fcbf7b9 None admin] RBAC: Authorizing `identity:get_user(user_id=e408088ee75748689b6af8c21ceb81d4)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.016398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ad58f-f70c-4d04-a438-7d4a2fcbf7b9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.018069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 161/313] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/users/e408088ee75748689b6af8c21ceb81d4 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:56.024419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ad58f-f70c-4d04-a438-7d4a2fcbf7b9 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:56.040945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284ce7-15b3-4d26-b5a1-8d00da05219f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.078411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33deb17-579a-46c5-a4b6-19db06e55acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.078974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33deb17-579a-46c5-a4b6-19db06e55acd None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.079258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33deb17-579a-46c5-a4b6-19db06e55acd None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.079536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33deb17-579a-46c5-a4b6-19db06e55acd None admin] PATH_INFO: `/v3/users/39e0911537e54191bb8c5f69be781fae` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.080706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33deb17-579a-46c5-a4b6-19db06e55acd None admin] RBAC: Authorizing `identity:get_user(user_id=39e0911537e54191bb8c5f69be781fae)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.082199 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33deb17-579a-46c5-a4b6-19db06e55acd None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.089340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 153/314] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/users/39e0911537e54191bb8c5f69be781fae => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:56.090486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33deb17-579a-46c5-a4b6-19db06e55acd None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:56.142284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:56.147655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ad58f-f70c-4d04-a438-7d4a2fcbf7b9 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.162169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:56.185845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5ea4c-6e24-4bff-8a6d-5565a3e077a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.187085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ea4c-6e24-4bff-8a6d-5565a3e077a1 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.187513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ea4c-6e24-4bff-8a6d-5565a3e077a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.187941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ea4c-6e24-4bff-8a6d-5565a3e077a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.202743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33deb17-579a-46c5-a4b6-19db06e55acd None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.238688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d3f04-d738-4283-98e7-718f7a35bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.239384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d3f04-d738-4283-98e7-718f7a35bcf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.239669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d3f04-d738-4283-98e7-718f7a35bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.239948 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d3f04-d738-4283-98e7-718f7a35bcf5 None admin] PATH_INFO: `/v3/system/users/39e0911537e54191bb8c5f69be781fae/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.241500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d3f04-d738-4283-98e7-718f7a35bcf5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=39e0911537e54191bb8c5f69be781fae, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.243042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d3f04-d738-4283-98e7-718f7a35bcf5 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.268440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5ea4c-6e24-4bff-8a6d-5565a3e077a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.269984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5ea4c-6e24-4bff-8a6d-5565a3e077a1 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.365065 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 154/315] 10.222.0.42 () {58 vars in 1334 bytes} [Wed Aug 31 19:07:56 2022] PUT /identity/v3/system/users/39e0911537e54191bb8c5f69be781fae/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:07:56.381617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:56.388623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 162/316] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:07:56.394399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d3f04-d738-4283-98e7-718f7a35bcf5 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:56.516518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d3f04-d738-4283-98e7-718f7a35bcf5 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.549427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:56.556510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54698f-1e7f-4ed1-9d26-8b6fb1b708e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.557195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54698f-1e7f-4ed1-9d26-8b6fb1b708e4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.557477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54698f-1e7f-4ed1-9d26-8b6fb1b708e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.557785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54698f-1e7f-4ed1-9d26-8b6fb1b708e4 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.559061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54698f-1e7f-4ed1-9d26-8b6fb1b708e4 None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.560610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54698f-1e7f-4ed1-9d26-8b6fb1b708e4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.563084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 155/317] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:07:56 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:56.570053 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5ea4c-6e24-4bff-8a6d-5565a3e077a1 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:56.677298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5ea4c-6e24-4bff-8a6d-5565a3e077a1 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.716118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61af90-f790-4b3b-89e6-35ff3fc617c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.716729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61af90-f790-4b3b-89e6-35ff3fc617c6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.717014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61af90-f790-4b3b-89e6-35ff3fc617c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.717291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61af90-f790-4b3b-89e6-35ff3fc617c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.718064 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61af90-f790-4b3b-89e6-35ff3fc617c6 None admin] RBAC: Adding query filter params (role.id=d2ed58a85e7941fcadc0916d8c31fdb2, scope.project.id=c85373107052445eb6721136e8247abd, user.id=e408088ee75748689b6af8c21ceb81d4) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:56.718376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61af90-f790-4b3b-89e6-35ff3fc617c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.719812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61af90-f790-4b3b-89e6-35ff3fc617c6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.726789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 163/318] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:56 2022] GET /identity/v3/role_assignments?user.id=e408088ee75748689b6af8c21ceb81d4&scope.project.id=c85373107052445eb6721136e8247abd&role.id=d2ed58a85e7941fcadc0916d8c31fdb2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:57.431847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c963d-5357-465a-8858-1620cbba6ce3 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.432357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c963d-5357-465a-8858-1620cbba6ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.432431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c963d-5357-465a-8858-1620cbba6ce3 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.433961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 156/319] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:57.439082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6009de-88cd-4302-b09c-64d2638500c4 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.439520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6009de-88cd-4302-b09c-64d2638500c4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.439700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6009de-88cd-4302-b09c-64d2638500c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.458562 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ce6009de-88cd-4302-b09c-64d2638500c4 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:57.459767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ce6009de-88cd-4302-b09c-64d2638500c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:57.522333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:57.534323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 164/320] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:57.620528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c529d1-ceac-4f24-bebd-a17f76c00921 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.620828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c529d1-ceac-4f24-bebd-a17f76c00921 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.621089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c529d1-ceac-4f24-bebd-a17f76c00921 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.622604 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 157/321] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:57.627573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981214fe-0e39-4689-ad90-14a126832b15 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.627870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981214fe-0e39-4689-ad90-14a126832b15 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.628151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981214fe-0e39-4689-ad90-14a126832b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.647768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-981214fe-0e39-4689-ad90-14a126832b15 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:57.648951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-981214fe-0e39-4689-ad90-14a126832b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:57.716152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 165/322] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:07:57.808320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c529d1-ceac-4f24-bebd-a17f76c00921 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:57.913357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c529d1-ceac-4f24-bebd-a17f76c00921 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:57.947941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b93dbe-5571-4108-8a83-541e050f7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:57.948573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93dbe-5571-4108-8a83-541e050f7e05 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:57.948852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93dbe-5571-4108-8a83-541e050f7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:57.949126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93dbe-5571-4108-8a83-541e050f7e05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:57.950255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b93dbe-5571-4108-8a83-541e050f7e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:57.951695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b93dbe-5571-4108-8a83-541e050f7e05 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:57.953310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 158/323] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:57.959190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981214fe-0e39-4689-ad90-14a126832b15 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:57.984014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b93dbe-5571-4108-8a83-541e050f7e05 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.050343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.090064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b93dbe-5571-4108-8a83-541e050f7e05 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.123641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981214fe-0e39-4689-ad90-14a126832b15 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.125478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d18ce-0161-4389-ac73-4222fe20ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.126175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d18ce-0161-4389-ac73-4222fe20ae46 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.126450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d18ce-0161-4389-ac73-4222fe20ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.126724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d18ce-0161-4389-ac73-4222fe20ae46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.138592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d18ce-0161-4389-ac73-4222fe20ae46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-736d18ce-0161-4389-ac73-4222fe20ae46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:58.144145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:58.145035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:58.146372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 159/324] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:58.150840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d18ce-0161-4389-ac73-4222fe20ae46 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.154066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.166380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df67ab2-7341-4baa-b9dc-666718ff802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.166989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67ab2-7341-4baa-b9dc-666718ff802e None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.167274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67ab2-7341-4baa-b9dc-666718ff802e None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.167557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67ab2-7341-4baa-b9dc-666718ff802e None admin] PATH_INFO: `/v3/groups` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.168215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df67ab2-7341-4baa-b9dc-666718ff802e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.169956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df67ab2-7341-4baa-b9dc-666718ff802e None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.255641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d18ce-0161-4389-ac73-4222fe20ae46 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.278761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 166/325] 10.222.0.42 () {60 vars in 1134 bytes} [Wed Aug 31 19:07:57 2022] POST /identity/v3/groups => generated 226 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:58.287094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.295427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a2f3c-e6b0-4426-84de-6538fec4329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.299892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a2f3c-e6b0-4426-84de-6538fec4329f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.299892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a2f3c-e6b0-4426-84de-6538fec4329f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.299892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a2f3c-e6b0-4426-84de-6538fec4329f None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.299892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a2f3c-e6b0-4426-84de-6538fec4329f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:58.299892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a2f3c-e6b0-4426-84de-6538fec4329f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.299892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a2f3c-e6b0-4426-84de-6538fec4329f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.309844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 160/326] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:58.315850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df67ab2-7341-4baa-b9dc-666718ff802e None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.380233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c92560-391e-477a-b2e7-de440b38d0f0 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.380588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c92560-391e-477a-b2e7-de440b38d0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.380770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c92560-391e-477a-b2e7-de440b38d0f0 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.382389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 161/327] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:07:58.387681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761640fa-13c2-400f-bdc5-e5cfc31f372b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.387959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761640fa-13c2-400f-bdc5-e5cfc31f372b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.388241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761640fa-13c2-400f-bdc5-e5cfc31f372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.407433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-761640fa-13c2-400f-bdc5-e5cfc31f372b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:58.408656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-761640fa-13c2-400f-bdc5-e5cfc31f372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:58.436800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df67ab2-7341-4baa-b9dc-666718ff802e None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.480018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d8e6e-00de-488a-b9bd-dcd74a8d9c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.480642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d8e6e-00de-488a-b9bd-dcd74a8d9c9a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.480922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d8e6e-00de-488a-b9bd-dcd74a8d9c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.481199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d8e6e-00de-488a-b9bd-dcd74a8d9c9a None admin] PATH_INFO: `/v3/users/9d8166a67ec04d6a9d73041c9cc55f80` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.482353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d8e6e-00de-488a-b9bd-dcd74a8d9c9a None admin] RBAC: Authorizing `identity:get_user(user_id=9d8166a67ec04d6a9d73041c9cc55f80)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.483799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d8e6e-00de-488a-b9bd-dcd74a8d9c9a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.485390 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 167/328] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/users/9d8166a67ec04d6a9d73041c9cc55f80 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:58.491284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 162/329] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:07:58.491749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d8e6e-00de-488a-b9bd-dcd74a8d9c9a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.557850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.612865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d8e6e-00de-488a-b9bd-dcd74a8d9c9a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.650866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c481254-0f88-4f5f-ac31-a1872197d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.651601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c481254-0f88-4f5f-ac31-a1872197d482 None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.651886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c481254-0f88-4f5f-ac31-a1872197d482 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.652171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c481254-0f88-4f5f-ac31-a1872197d482 None admin] PATH_INFO: `/v3/system/users/9d8166a67ec04d6a9d73041c9cc55f80/roles/d2ed58a85e7941fcadc0916d8c31fdb2` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.653603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c481254-0f88-4f5f-ac31-a1872197d482 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9d8166a67ec04d6a9d73041c9cc55f80, role_id=d2ed58a85e7941fcadc0916d8c31fdb2)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:58.655013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c481254-0f88-4f5f-ac31-a1872197d482 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:58.725157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 168/330] 10.222.0.42 () {58 vars in 1334 bytes} [Wed Aug 31 19:07:58 2022] PUT /identity/v3/system/users/9d8166a67ec04d6a9d73041c9cc55f80/roles/d2ed58a85e7941fcadc0916d8c31fdb2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:07:58.758689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761640fa-13c2-400f-bdc5-e5cfc31f372b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.885319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761640fa-13c2-400f-bdc5-e5cfc31f372b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.904801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:58.927538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d8760-fe91-49f0-8b37-6567a5ea7dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.928251 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d8760-fe91-49f0-8b37-6567a5ea7dda None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.928536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d8760-fe91-49f0-8b37-6567a5ea7dda None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.928806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d8760-fe91-49f0-8b37-6567a5ea7dda None admin] PATH_INFO: `/v3/roles/member` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.946929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d8760-fe91-49f0-8b37-6567a5ea7dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-5a0d8760-fe91-49f0-8b37-6567a5ea7dda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:58.952067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:58.952930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:07:58.953731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 163/331] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:58.959616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c481254-0f88-4f5f-ac31-a1872197d482 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.126569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c481254-0f88-4f5f-ac31-a1872197d482 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.141836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.168176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bdbc7-5e95-4bf9-8204-009b811fc83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.168793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bdbc7-5e95-4bf9-8204-009b811fc83f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.169072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bdbc7-5e95-4bf9-8204-009b811fc83f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.169351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bdbc7-5e95-4bf9-8204-009b811fc83f None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.170107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bdbc7-5e95-4bf9-8204-009b811fc83f None admin] RBAC: Adding query filter params (name=member) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.170412 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bdbc7-5e95-4bf9-8204-009b811fc83f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.171776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bdbc7-5e95-4bf9-8204-009b811fc83f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.181069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 169/332] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:59.186900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d8760-fe91-49f0-8b37-6567a5ea7dda None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.322069 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d8760-fe91-49f0-8b37-6567a5ea7dda None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.365780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968fc38-a1ef-4018-85cc-81056aef4001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.366441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968fc38-a1ef-4018-85cc-81056aef4001 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.366725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968fc38-a1ef-4018-85cc-81056aef4001 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.367002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968fc38-a1ef-4018-85cc-81056aef4001 None admin] PATH_INFO: `/v3/users/39e0911537e54191bb8c5f69be781fae` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.368340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968fc38-a1ef-4018-85cc-81056aef4001 None admin] RBAC: Authorizing `identity:get_user(user_id=39e0911537e54191bb8c5f69be781fae)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.369880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968fc38-a1ef-4018-85cc-81056aef4001 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.371822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 164/333] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/users/39e0911537e54191bb8c5f69be781fae => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:59.377866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bdbc7-5e95-4bf9-8204-009b811fc83f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.514980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bdbc7-5e95-4bf9-8204-009b811fc83f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.562398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959c49c-debb-4296-bcb2-c3612af267cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.563023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c49c-debb-4296-bcb2-c3612af267cb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.563308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c49c-debb-4296-bcb2-c3612af267cb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.563590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c49c-debb-4296-bcb2-c3612af267cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.564333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959c49c-debb-4296-bcb2-c3612af267cb None admin] RBAC: Adding query filter params (role.id=d1bf17fdde744527bb5905634f0b1b2c, user.id=39e0911537e54191bb8c5f69be781fae, scope.system=all) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.564645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959c49c-debb-4296-bcb2-c3612af267cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.566117 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959c49c-debb-4296-bcb2-c3612af267cb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.583305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 170/334] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/role_assignments?user.id=39e0911537e54191bb8c5f69be781fae&scope.system=all&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:00.818997 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9707-1385-47fe-ba7a-2627184b4802 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.819548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9707-1385-47fe-ba7a-2627184b4802 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.819548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d9707-1385-47fe-ba7a-2627184b4802 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.821399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 165/335] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:00.826796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027776bb-c7ca-48c6-92fb-ce4b7f63e48a None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.827218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027776bb-c7ca-48c6-92fb-ce4b7f63e48a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.827396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027776bb-c7ca-48c6-92fb-ce4b7f63e48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.851986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-027776bb-c7ca-48c6-92fb-ce4b7f63e48a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:00.853190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-027776bb-c7ca-48c6-92fb-ce4b7f63e48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:00.898364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:00.948652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 171/336] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:01.014546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633d44-162e-4b5d-8e48-b0cf4702c86a None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.014877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633d44-162e-4b5d-8e48-b0cf4702c86a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.015101 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633d44-162e-4b5d-8e48-b0cf4702c86a None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.016688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 166/337] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:01.026146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6be3f0-459e-4f51-a9ed-50efe705605c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.026448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6be3f0-459e-4f51-a9ed-50efe705605c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.026709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6be3f0-459e-4f51-a9ed-50efe705605c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.048877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-bd6be3f0-459e-4f51-a9ed-50efe705605c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:01.050105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bd6be3f0-459e-4f51-a9ed-50efe705605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:01.135203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 172/338] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:01.334831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633d44-162e-4b5d-8e48-b0cf4702c86a None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.392610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:01.454440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633d44-162e-4b5d-8e48-b0cf4702c86a None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.505258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f46ee1-5635-4677-bc6b-092f4d094f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.505911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f46ee1-5635-4677-bc6b-092f4d094f31 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.506198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f46ee1-5635-4677-bc6b-092f4d094f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.506467 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f46ee1-5635-4677-bc6b-092f4d094f31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.519586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f46ee1-5635-4677-bc6b-092f4d094f31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-51f46ee1-5635-4677-bc6b-092f4d094f31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:01.525037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:01.526044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:01.526868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 167/339] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:01.532239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6be3f0-459e-4f51-a9ed-50efe705605c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.633540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614eb26-1062-4a15-b952-6fac592f035b None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.633910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614eb26-1062-4a15-b952-6fac592f035b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.634159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614eb26-1062-4a15-b952-6fac592f035b None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.636755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 168/340] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:01.641043 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0ef31-bec1-408e-b985-4142fe10811d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.641329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0ef31-bec1-408e-b985-4142fe10811d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.641606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0ef31-bec1-408e-b985-4142fe10811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.664897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-37e0ef31-bec1-408e-b985-4142fe10811d None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:01.666134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-37e0ef31-bec1-408e-b985-4142fe10811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:01.670981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:01.680967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6be3f0-459e-4f51-a9ed-50efe705605c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.728937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56595f85-019a-4a35-bd04-dddfbc80bf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.729560 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56595f85-019a-4a35-bd04-dddfbc80bf2d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.729867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56595f85-019a-4a35-bd04-dddfbc80bf2d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.730142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56595f85-019a-4a35-bd04-dddfbc80bf2d None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:01.730921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56595f85-019a-4a35-bd04-dddfbc80bf2d None admin] RBAC: Adding query filter params (name=member) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:01.731227 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56595f85-019a-4a35-bd04-dddfbc80bf2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:01.732688 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56595f85-019a-4a35-bd04-dddfbc80bf2d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:01.742872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 169/341] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:01.748347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 173/342] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:01.749043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56595f85-019a-4a35-bd04-dddfbc80bf2d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.754871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0ef31-bec1-408e-b985-4142fe10811d None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:01.816916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:01.892903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0ef31-bec1-408e-b985-4142fe10811d None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:01.938312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c28048-a275-450b-af83-3a16236977de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:01.938933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c28048-a275-450b-af83-3a16236977de None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:01.939210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c28048-a275-450b-af83-3a16236977de None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:01.939484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c28048-a275-450b-af83-3a16236977de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.000718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56595f85-019a-4a35-bd04-dddfbc80bf2d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.041466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba293c2-9fd7-4146-87b7-fd328b30e9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.042150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba293c2-9fd7-4146-87b7-fd328b30e9dd None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.042432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba293c2-9fd7-4146-87b7-fd328b30e9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.042710 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba293c2-9fd7-4146-87b7-fd328b30e9dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.056572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba293c2-9fd7-4146-87b7-fd328b30e9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-2ba293c2-9fd7-4146-87b7-fd328b30e9dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:02.062314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:02.063194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:02.063959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 174/343] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:02.064641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2ab44-5448-4cf8-869f-a12ea51d7b63 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.065198 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2ab44-5448-4cf8-869f-a12ea51d7b63 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.065198 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2ab44-5448-4cf8-869f-a12ea51d7b63 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.071219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 175/344] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:02.077976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909817cd-348c-4f92-b92d-83862ca4751c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.077976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909817cd-348c-4f92-b92d-83862ca4751c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.077976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909817cd-348c-4f92-b92d-83862ca4751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.082765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c28048-a275-450b-af83-3a16236977de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.084508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c28048-a275-450b-af83-3a16236977de None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.099285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-909817cd-348c-4f92-b92d-83862ca4751c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:02.100556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-909817cd-348c-4f92-b92d-83862ca4751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:02.112328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.152078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.179468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 176/345] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:02.180619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909817cd-348c-4f92-b92d-83862ca4751c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.265703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 170/346] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:08:02.266321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c28048-a275-450b-af83-3a16236977de None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.386314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c28048-a275-450b-af83-3a16236977de None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.419662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909817cd-348c-4f92-b92d-83862ca4751c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.425594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44157546-6699-4f5c-b952-1d3c1f827293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.427682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44157546-6699-4f5c-b952-1d3c1f827293 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.428189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44157546-6699-4f5c-b952-1d3c1f827293 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.428674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44157546-6699-4f5c-b952-1d3c1f827293 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.435049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.446790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44157546-6699-4f5c-b952-1d3c1f827293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-44157546-6699-4f5c-b952-1d3c1f827293 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:02.459264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:02.460292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:02.461061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:02.464951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 171/347] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:02.465896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44157546-6699-4f5c-b952-1d3c1f827293 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.496332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637c9b-ba63-479b-99fd-a6f26f31f2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.498369 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637c9b-ba63-479b-99fd-a6f26f31f2ef None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.498656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637c9b-ba63-479b-99fd-a6f26f31f2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.500217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637c9b-ba63-479b-99fd-a6f26f31f2ef None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.500938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45637c9b-ba63-479b-99fd-a6f26f31f2ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:02.501250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45637c9b-ba63-479b-99fd-a6f26f31f2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.505599 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45637c9b-ba63-479b-99fd-a6f26f31f2ef None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.523214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 177/348] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:02.528074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637c9b-ba63-479b-99fd-a6f26f31f2ef None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.545006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.631007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44157546-6699-4f5c-b952-1d3c1f827293 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.666940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637c9b-ba63-479b-99fd-a6f26f31f2ef None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.685314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e16192-9294-4894-8ad2-a1b42a3ac5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.686283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e16192-9294-4894-8ad2-a1b42a3ac5ec None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.686566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e16192-9294-4894-8ad2-a1b42a3ac5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.686844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e16192-9294-4894-8ad2-a1b42a3ac5ec None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.689059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e16192-9294-4894-8ad2-a1b42a3ac5ec None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.690568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e16192-9294-4894-8ad2-a1b42a3ac5ec None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.692851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 172/349] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:02.693511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e16192-9294-4894-8ad2-a1b42a3ac5ec None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.716993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284c00b-5899-4c6c-aa42-deb8c1cd2d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.717615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284c00b-5899-4c6c-aa42-deb8c1cd2d1f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.717925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284c00b-5899-4c6c-aa42-deb8c1cd2d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.718671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284c00b-5899-4c6c-aa42-deb8c1cd2d1f None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.719359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284c00b-5899-4c6c-aa42-deb8c1cd2d1f None admin] RBAC: Adding query filter params (name=member) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:02.719944 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284c00b-5899-4c6c-aa42-deb8c1cd2d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.721491 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284c00b-5899-4c6c-aa42-deb8c1cd2d1f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:02.732098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 178/350] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:02.734424 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8cf6-333f-4e8c-a226-ba64143925c5 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.734717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8cf6-333f-4e8c-a226-ba64143925c5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.734992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa8cf6-333f-4e8c-a226-ba64143925c5 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.736250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 179/351] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:02.737022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa8cf6-333f-4e8c-a226-ba64143925c5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.767681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.815789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e16192-9294-4894-8ad2-a1b42a3ac5ec None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.822138 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:02.865512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048214d-c427-40ee-a4ef-9bb9d07f2361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.866533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa8cf6-333f-4e8c-a226-ba64143925c5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:02.867003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048214d-c427-40ee-a4ef-9bb9d07f2361 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.867303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048214d-c427-40ee-a4ef-9bb9d07f2361 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.867580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048214d-c427-40ee-a4ef-9bb9d07f2361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.921629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71583b05-1955-4561-b994-701dda98240c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:02.922309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71583b05-1955-4561-b994-701dda98240c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.922600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71583b05-1955-4561-b994-701dda98240c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.922875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71583b05-1955-4561-b994-701dda98240c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.933903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71583b05-1955-4561-b994-701dda98240c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-71583b05-1955-4561-b994-701dda98240c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:02.939316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:02.940221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 180/352] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:02.942537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71583b05-1955-4561-b994-701dda98240c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:02.959310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048214d-c427-40ee-a4ef-9bb9d07f2361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:02.960781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048214d-c427-40ee-a4ef-9bb9d07f2361 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.041087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.066989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71583b05-1955-4561-b994-701dda98240c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.091195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 173/353] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:03.092826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386d877-e2e9-4990-89ca-ea44ee59277e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.093117 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386d877-e2e9-4990-89ca-ea44ee59277e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.093391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386d877-e2e9-4990-89ca-ea44ee59277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.099584 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.109198 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88023e70-12bc-4801-b439-5f34d4202806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.113600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88023e70-12bc-4801-b439-5f34d4202806 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.113600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88023e70-12bc-4801-b439-5f34d4202806 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.113600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88023e70-12bc-4801-b439-5f34d4202806 None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.116852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1386d877-e2e9-4990-89ca-ea44ee59277e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:03.116852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1386d877-e2e9-4990-89ca-ea44ee59277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:03.119473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88023e70-12bc-4801-b439-5f34d4202806 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.121018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88023e70-12bc-4801-b439-5f34d4202806 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.122311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 181/354] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:02 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:03.123299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88023e70-12bc-4801-b439-5f34d4202806 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.199248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 174/355] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:03.199982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386d877-e2e9-4990-89ca-ea44ee59277e None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.245458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88023e70-12bc-4801-b439-5f34d4202806 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.287095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4a6f2-5c1f-448a-919a-45572fcc258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.287095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4a6f2-5c1f-448a-919a-45572fcc258d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.287379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4a6f2-5c1f-448a-919a-45572fcc258d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.287633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4a6f2-5c1f-448a-919a-45572fcc258d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.321011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.336253 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386d877-e2e9-4990-89ca-ea44ee59277e None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.368933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.378391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4a6f2-5c1f-448a-919a-45572fcc258d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.380433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4a6f2-5c1f-448a-919a-45572fcc258d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.387233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c661f-00dc-4b54-bdfc-85ca604f0177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.387886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c661f-00dc-4b54-bdfc-85ca604f0177 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.388175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c661f-00dc-4b54-bdfc-85ca604f0177 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.388449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c661f-00dc-4b54-bdfc-85ca604f0177 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.389393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c661f-00dc-4b54-bdfc-85ca604f0177 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:03.389506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c661f-00dc-4b54-bdfc-85ca604f0177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.390949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c661f-00dc-4b54-bdfc-85ca604f0177 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.400798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 175/356] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:03.402061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6a10a-1281-423c-a630-1693a3c3957e None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.402346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6a10a-1281-423c-a630-1693a3c3957e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.402622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6a10a-1281-423c-a630-1693a3c3957e None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.403838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 176/357] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:03.404530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6a10a-1281-423c-a630-1693a3c3957e None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.508836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 182/358] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:03.509743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4a6f2-5c1f-448a-919a-45572fcc258d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.550248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6a10a-1281-423c-a630-1693a3c3957e None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.594309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658e8d8-26e7-4017-b9f8-e060a48f5d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.596154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658e8d8-26e7-4017-b9f8-e060a48f5d79 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.596440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658e8d8-26e7-4017-b9f8-e060a48f5d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.596727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658e8d8-26e7-4017-b9f8-e060a48f5d79 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.599189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658e8d8-26e7-4017-b9f8-e060a48f5d79 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.600645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658e8d8-26e7-4017-b9f8-e060a48f5d79 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.602328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 177/359] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:03.603174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658e8d8-26e7-4017-b9f8-e060a48f5d79 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.626400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.633290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4a6f2-5c1f-448a-919a-45572fcc258d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.635184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.672386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83024bfb-fff0-4448-9912-1fdd3da075bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.673033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83024bfb-fff0-4448-9912-1fdd3da075bb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.673316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83024bfb-fff0-4448-9912-1fdd3da075bb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.673593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83024bfb-fff0-4448-9912-1fdd3da075bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.674374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83024bfb-fff0-4448-9912-1fdd3da075bb None admin] RBAC: Adding query filter params (group.id=3ffb37cd669b465ba985dbc95f0391c5, role.id=d1bf17fdde744527bb5905634f0b1b2c, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:03.674682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83024bfb-fff0-4448-9912-1fdd3da075bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.676195 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83024bfb-fff0-4448-9912-1fdd3da075bb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.685394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 183/360] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/role_assignments?group.id=3ffb37cd669b465ba985dbc95f0391c5&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:03.685394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40964d-da79-451d-9165-d637bf8522f3 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.685394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40964d-da79-451d-9165-d637bf8522f3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.685394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40964d-da79-451d-9165-d637bf8522f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.711316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-fe40964d-da79-451d-9165-d637bf8522f3 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:03.712735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-fe40964d-da79-451d-9165-d637bf8522f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:03.738551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658e8d8-26e7-4017-b9f8-e060a48f5d79 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.788337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2475f43-fbdc-41a6-95c4-a62bfca8686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.789328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2475f43-fbdc-41a6-95c4-a62bfca8686f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.789779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2475f43-fbdc-41a6-95c4-a62bfca8686f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.790192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2475f43-fbdc-41a6-95c4-a62bfca8686f None admin] PATH_INFO: `/v3/users/9d8166a67ec04d6a9d73041c9cc55f80` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.791621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2475f43-fbdc-41a6-95c4-a62bfca8686f None admin] RBAC: Authorizing `identity:get_user(user_id=9d8166a67ec04d6a9d73041c9cc55f80)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.793437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2475f43-fbdc-41a6-95c4-a62bfca8686f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.795417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 178/361] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/users/9d8166a67ec04d6a9d73041c9cc55f80 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:03.796213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2475f43-fbdc-41a6-95c4-a62bfca8686f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.807915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 184/362] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:03.809189 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40964d-da79-451d-9165-d637bf8522f3 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.939084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.939540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.951672 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2475f43-fbdc-41a6-95c4-a62bfca8686f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.956635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40964d-da79-451d-9165-d637bf8522f3 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.992192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45107d76-c6b6-4f57-989d-3cb2a17ef83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.996978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107d76-c6b6-4f57-989d-3cb2a17ef83e None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.996978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107d76-c6b6-4f57-989d-3cb2a17ef83e None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.996978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45107d76-c6b6-4f57-989d-3cb2a17ef83e None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.996978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45107d76-c6b6-4f57-989d-3cb2a17ef83e None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.996978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45107d76-c6b6-4f57-989d-3cb2a17ef83e None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.998317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 185/363] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:03.999095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45107d76-c6b6-4f57-989d-3cb2a17ef83e None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.001272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717856ab-03c2-4c65-a342-c0dfd558b5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.002302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717856ab-03c2-4c65-a342-c0dfd558b5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.002590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717856ab-03c2-4c65-a342-c0dfd558b5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.002867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717856ab-03c2-4c65-a342-c0dfd558b5f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.019293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717856ab-03c2-4c65-a342-c0dfd558b5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-717856ab-03c2-4c65-a342-c0dfd558b5f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:04.024833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:04.025705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:04.026474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:04.028829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 179/364] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:04.032469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717856ab-03c2-4c65-a342-c0dfd558b5f2 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.121562 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45107d76-c6b6-4f57-989d-3cb2a17ef83e None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.163752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4ffea-9e8a-402e-9fa0-b8f0a81ea094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.164397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4ffea-9e8a-402e-9fa0-b8f0a81ea094 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.164677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4ffea-9e8a-402e-9fa0-b8f0a81ea094 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.164950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4ffea-9e8a-402e-9fa0-b8f0a81ea094 None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.167938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4ffea-9e8a-402e-9fa0-b8f0a81ea094 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.169444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4ffea-9e8a-402e-9fa0-b8f0a81ea094 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.171243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717856ab-03c2-4c65-a342-c0dfd558b5f2 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.171374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 186/365] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:04.171850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4ffea-9e8a-402e-9fa0-b8f0a81ea094 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.210646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.216755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743ed7f-9f5e-4eb5-b357-bb44e0ea87e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.217584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743ed7f-9f5e-4eb5-b357-bb44e0ea87e6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.225557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743ed7f-9f5e-4eb5-b357-bb44e0ea87e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.225557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743ed7f-9f5e-4eb5-b357-bb44e0ea87e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.225557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743ed7f-9f5e-4eb5-b357-bb44e0ea87e6 None admin] RBAC: Adding query filter params (role.id=d2ed58a85e7941fcadc0916d8c31fdb2, user.id=9d8166a67ec04d6a9d73041c9cc55f80, scope.system=all) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:04.225557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743ed7f-9f5e-4eb5-b357-bb44e0ea87e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.225557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743ed7f-9f5e-4eb5-b357-bb44e0ea87e6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.235965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 180/366] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/role_assignments?user.id=9d8166a67ec04d6a9d73041c9cc55f80&scope.system=all&role.id=d2ed58a85e7941fcadc0916d8c31fdb2 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:04.236817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743ed7f-9f5e-4eb5-b357-bb44e0ea87e6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.253858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.315071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4ffea-9e8a-402e-9fa0-b8f0a81ea094 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.356885 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42726418-a71e-4ae0-ad23-b9ba8eb22530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.357541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42726418-a71e-4ae0-ad23-b9ba8eb22530 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.357849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42726418-a71e-4ae0-ad23-b9ba8eb22530 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.358126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42726418-a71e-4ae0-ad23-b9ba8eb22530 None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.359438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42726418-a71e-4ae0-ad23-b9ba8eb22530 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.360970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42726418-a71e-4ae0-ad23-b9ba8eb22530 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.362777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 187/367] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:04.363681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42726418-a71e-4ae0-ad23-b9ba8eb22530 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.373112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743ed7f-9f5e-4eb5-b357-bb44e0ea87e6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.411517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fea00c-64b6-47d8-8f4c-b409a7cb119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.412145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fea00c-64b6-47d8-8f4c-b409a7cb119c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.412425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fea00c-64b6-47d8-8f4c-b409a7cb119c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.412701 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fea00c-64b6-47d8-8f4c-b409a7cb119c None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.413396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fea00c-64b6-47d8-8f4c-b409a7cb119c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:04.413732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fea00c-64b6-47d8-8f4c-b409a7cb119c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.415150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fea00c-64b6-47d8-8f4c-b409a7cb119c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.424355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 181/368] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:04.425223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fea00c-64b6-47d8-8f4c-b409a7cb119c None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.471635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.483903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42726418-a71e-4ae0-ad23-b9ba8eb22530 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.507668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.530060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c004f4-ebfa-48a8-8205-ddfa0ef72e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.530792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c004f4-ebfa-48a8-8205-ddfa0ef72e8b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.531077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c004f4-ebfa-48a8-8205-ddfa0ef72e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.531350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c004f4-ebfa-48a8-8205-ddfa0ef72e8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.548429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fea00c-64b6-47d8-8f4c-b409a7cb119c None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.549218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c004f4-ebfa-48a8-8205-ddfa0ef72e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-60c004f4-ebfa-48a8-8205-ddfa0ef72e8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:04.556048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:04.557776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 188/369] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:04.558854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c004f4-ebfa-48a8-8205-ddfa0ef72e8b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.592960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4efe-4573-4152-81f3-6fa785f8d512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.593576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4efe-4573-4152-81f3-6fa785f8d512 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.593903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4efe-4573-4152-81f3-6fa785f8d512 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.594181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4efe-4573-4152-81f3-6fa785f8d512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.594917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c4efe-4573-4152-81f3-6fa785f8d512 None admin] RBAC: Adding query filter params (group.id=3ffb37cd669b465ba985dbc95f0391c5, role.id=3ba2e6e2ec814831bb3bc254484024d2, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:04.595227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c4efe-4573-4152-81f3-6fa785f8d512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.596677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c4efe-4573-4152-81f3-6fa785f8d512 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.603652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 182/370] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/role_assignments?group.id=3ffb37cd669b465ba985dbc95f0391c5&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=3ba2e6e2ec814831bb3bc254484024d2 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:04.604489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4efe-4573-4152-81f3-6fa785f8d512 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.701181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c004f4-ebfa-48a8-8205-ddfa0ef72e8b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.740031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4efe-4573-4152-81f3-6fa785f8d512 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.741844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88752cc-1e4a-4c6d-af6d-23f2c7db21cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.742587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88752cc-1e4a-4c6d-af6d-23f2c7db21cc None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.743122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88752cc-1e4a-4c6d-af6d-23f2c7db21cc None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.743526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88752cc-1e4a-4c6d-af6d-23f2c7db21cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.744660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88752cc-1e4a-4c6d-af6d-23f2c7db21cc None admin] RBAC: Adding query filter params (group.id=3ffb37cd669b465ba985dbc95f0391c5, role.id=d1bf17fdde744527bb5905634f0b1b2c, scope.project.id=c85373107052445eb6721136e8247abd) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:04.744660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88752cc-1e4a-4c6d-af6d-23f2c7db21cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.746470 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88752cc-1e4a-4c6d-af6d-23f2c7db21cc None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.753474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 189/371] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/role_assignments?group.id=3ffb37cd669b465ba985dbc95f0391c5&scope.project.id=c85373107052445eb6721136e8247abd&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:04.761868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88752cc-1e4a-4c6d-af6d-23f2c7db21cc None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.786464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166869-5392-4b37-b609-fb316c8317d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.787465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166869-5392-4b37-b609-fb316c8317d9 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.787985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166869-5392-4b37-b609-fb316c8317d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.788455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166869-5392-4b37-b609-fb316c8317d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.792835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.794037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.881754 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9166869-5392-4b37-b609-fb316c8317d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.883489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9166869-5392-4b37-b609-fb316c8317d9 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.995721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88752cc-1e4a-4c6d-af6d-23f2c7db21cc None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.044630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bcc2f-6c62-4fb7-bad5-90b238db21c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.045246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bcc2f-6c62-4fb7-bad5-90b238db21c5 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.045526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bcc2f-6c62-4fb7-bad5-90b238db21c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.045830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bcc2f-6c62-4fb7-bad5-90b238db21c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.046500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bcc2f-6c62-4fb7-bad5-90b238db21c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:05.046797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bcc2f-6c62-4fb7-bad5-90b238db21c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.048164 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bcc2f-6c62-4fb7-bad5-90b238db21c5 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.055235 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 183/372] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:05.061211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166869-5392-4b37-b609-fb316c8317d9 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.064861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 190/373] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:05.074903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bcc2f-6c62-4fb7-bad5-90b238db21c5 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.123254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.218047 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.228527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bcc2f-6c62-4fb7-bad5-90b238db21c5 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.248834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166869-5392-4b37-b609-fb316c8317d9 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.291674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9c3c2-c518-4275-9e87-773b2fa9f414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.292291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9c3c2-c518-4275-9e87-773b2fa9f414 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.292572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9c3c2-c518-4275-9e87-773b2fa9f414 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.292844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9c3c2-c518-4275-9e87-773b2fa9f414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.312697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78979cba-0e08-48b8-99d7-1815ad7227c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.313334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78979cba-0e08-48b8-99d7-1815ad7227c5 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.313619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78979cba-0e08-48b8-99d7-1815ad7227c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.313915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78979cba-0e08-48b8-99d7-1815ad7227c5 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.315176 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78979cba-0e08-48b8-99d7-1815ad7227c5 None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.316614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78979cba-0e08-48b8-99d7-1815ad7227c5 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.319012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 184/374] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:05.324786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78979cba-0e08-48b8-99d7-1815ad7227c5 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.418718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9c3c2-c518-4275-9e87-773b2fa9f414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.420177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9c3c2-c518-4275-9e87-773b2fa9f414 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.482265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78979cba-0e08-48b8-99d7-1815ad7227c5 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.491883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.561441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e8d74-867e-4a22-9bdb-77435a515851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.562093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8d74-867e-4a22-9bdb-77435a515851 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.562370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8d74-867e-4a22-9bdb-77435a515851 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.568357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8d74-867e-4a22-9bdb-77435a515851 None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.569705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e8d74-867e-4a22-9bdb-77435a515851 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.571396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e8d74-867e-4a22-9bdb-77435a515851 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.573310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 185/375] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:05.578011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.583222 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e8d74-867e-4a22-9bdb-77435a515851 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.619871 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 191/376] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:08:05.626571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9c3c2-c518-4275-9e87-773b2fa9f414 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.774945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e8d74-867e-4a22-9bdb-77435a515851 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.809411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9c3c2-c518-4275-9e87-773b2fa9f414 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.843663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621aa8ae-05c9-42ed-9c87-d11414b11aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.844271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621aa8ae-05c9-42ed-9c87-d11414b11aff None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.844547 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621aa8ae-05c9-42ed-9c87-d11414b11aff None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.844817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621aa8ae-05c9-42ed-9c87-d11414b11aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.845532 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621aa8ae-05c9-42ed-9c87-d11414b11aff None admin] RBAC: Adding query filter params (group.id=3ffb37cd669b465ba985dbc95f0391c5, role.id=3ba2e6e2ec814831bb3bc254484024d2, scope.project.id=c85373107052445eb6721136e8247abd) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:05.845861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621aa8ae-05c9-42ed-9c87-d11414b11aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.847549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621aa8ae-05c9-42ed-9c87-d11414b11aff None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.854231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 186/377] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/role_assignments?group.id=3ffb37cd669b465ba985dbc95f0391c5&scope.project.id=c85373107052445eb6721136e8247abd&role.id=3ba2e6e2ec814831bb3bc254484024d2 => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:05.867326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbbc5b-af9a-475c-81b4-7893c37bc2e0 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.867650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbbc5b-af9a-475c-81b4-7893c37bc2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.867895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbbc5b-af9a-475c-81b4-7893c37bc2e0 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.869352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 187/378] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:05.874618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950ebb4-7ae8-4c6a-8369-9402ddadfe8e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.874900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950ebb4-7ae8-4c6a-8369-9402ddadfe8e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.875183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950ebb4-7ae8-4c6a-8369-9402ddadfe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.879660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55a394-0888-4874-bff9-3c71591c9499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.880588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55a394-0888-4874-bff9-3c71591c9499 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.881022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55a394-0888-4874-bff9-3c71591c9499 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.881449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55a394-0888-4874-bff9-3c71591c9499 None admin] PATH_INFO: `/v3/projects/e050b6f9e66f4591994e7fdf0d98777d` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.883892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55a394-0888-4874-bff9-3c71591c9499 None admin] RBAC: Authorizing `identity:get_project(project_id=e050b6f9e66f4591994e7fdf0d98777d)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.885600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55a394-0888-4874-bff9-3c71591c9499 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.887887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 192/379] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/projects/e050b6f9e66f4591994e7fdf0d98777d => generated 344 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:05.902511 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55a394-0888-4874-bff9-3c71591c9499 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.918904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-0950ebb4-7ae8-4c6a-8369-9402ddadfe8e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:05.920248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0950ebb4-7ae8-4c6a-8369-9402ddadfe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:05.960453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.983664 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:06.026442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55a394-0888-4874-bff9-3c71591c9499 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.029726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 188/380] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:06.070090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0a8ff-7e46-4aab-a146-831aaf22df1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.071386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0a8ff-7e46-4aab-a146-831aaf22df1c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.071850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0a8ff-7e46-4aab-a146-831aaf22df1c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.072304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0a8ff-7e46-4aab-a146-831aaf22df1c None admin] PATH_INFO: `/v3/groups/8450ed67dc3b484886933b94f081e2a6` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.078275 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0a8ff-7e46-4aab-a146-831aaf22df1c None admin] RBAC: Authorizing `identity:get_group(group_id=8450ed67dc3b484886933b94f081e2a6)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.079959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0a8ff-7e46-4aab-a146-831aaf22df1c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.082278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 193/381] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/groups/8450ed67dc3b484886933b94f081e2a6 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:06.088476 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950ebb4-7ae8-4c6a-8369-9402ddadfe8e None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.221192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950ebb4-7ae8-4c6a-8369-9402ddadfe8e None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.261457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd57e9-f67e-4312-b2ef-8d640cdca79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.262090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd57e9-f67e-4312-b2ef-8d640cdca79a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.262366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd57e9-f67e-4312-b2ef-8d640cdca79a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.262632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd57e9-f67e-4312-b2ef-8d640cdca79a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.263353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd57e9-f67e-4312-b2ef-8d640cdca79a None admin] RBAC: Adding query filter params (group.id=8450ed67dc3b484886933b94f081e2a6, role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=e050b6f9e66f4591994e7fdf0d98777d) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:06.263662 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd57e9-f67e-4312-b2ef-8d640cdca79a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.265081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd57e9-f67e-4312-b2ef-8d640cdca79a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.272936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 189/382] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/role_assignments?group.id=8450ed67dc3b484886933b94f081e2a6&scope.project.id=e050b6f9e66f4591994e7fdf0d98777d&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:06.393869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0a8ff-7e46-4aab-a146-831aaf22df1c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.513545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0a8ff-7e46-4aab-a146-831aaf22df1c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.526481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:06.550627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5dac-d808-4afe-8444-aa676c1063dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.551306 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5dac-d808-4afe-8444-aa676c1063dd None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.551596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5dac-d808-4afe-8444-aa676c1063dd None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.551876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5dac-d808-4afe-8444-aa676c1063dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.562902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d5dac-d808-4afe-8444-aa676c1063dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-6d2d5dac-d808-4afe-8444-aa676c1063dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:06.568577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:06.569705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:06.570764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:06.573381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 194/383] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:06.578960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd57e9-f67e-4312-b2ef-8d640cdca79a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.611797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:06.709895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd57e9-f67e-4312-b2ef-8d640cdca79a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.762326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f7c9-5ceb-4031-a880-8d1a2ebe875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.762941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f7c9-5ceb-4031-a880-8d1a2ebe875a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.763219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f7c9-5ceb-4031-a880-8d1a2ebe875a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.763488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f7c9-5ceb-4031-a880-8d1a2ebe875a None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.764151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076f7c9-5ceb-4031-a880-8d1a2ebe875a None admin] RBAC: Adding query filter params (name=member) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:06.764449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076f7c9-5ceb-4031-a880-8d1a2ebe875a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.765832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076f7c9-5ceb-4031-a880-8d1a2ebe875a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.778026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 190/384] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:06.783570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5dac-d808-4afe-8444-aa676c1063dd None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:06.891692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5dac-d808-4afe-8444-aa676c1063dd None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:06.927384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21014-1292-4334-9d02-728dd4dcf5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:06.928417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21014-1292-4334-9d02-728dd4dcf5bc None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:06.928914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21014-1292-4334-9d02-728dd4dcf5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:06.929439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21014-1292-4334-9d02-728dd4dcf5bc None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:06.930851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead21014-1292-4334-9d02-728dd4dcf5bc None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:06.932554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead21014-1292-4334-9d02-728dd4dcf5bc None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:06.934760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 195/385] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:06.941716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f7c9-5ceb-4031-a880-8d1a2ebe875a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.072185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.081559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f7c9-5ceb-4031-a880-8d1a2ebe875a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.125099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b4572-c300-497a-8003-8d1724ca44b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.125776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b4572-c300-497a-8003-8d1724ca44b3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.126044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b4572-c300-497a-8003-8d1724ca44b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.126317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b4572-c300-497a-8003-8d1724ca44b3 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.127496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b4572-c300-497a-8003-8d1724ca44b3 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.128930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b4572-c300-497a-8003-8d1724ca44b3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.131539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 191/386] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:06 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:07.137111 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21014-1292-4334-9d02-728dd4dcf5bc None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.209698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.251335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13c461-4d88-4073-976f-843ded585d90 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.251523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13c461-4d88-4073-976f-843ded585d90 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.251771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13c461-4d88-4073-976f-843ded585d90 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.253312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 192/387] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:07.260226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1403a6-d8dc-44ae-8ae9-d2044a40989f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.260903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1403a6-d8dc-44ae-8ae9-d2044a40989f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.261382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1403a6-d8dc-44ae-8ae9-d2044a40989f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.287836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21014-1292-4334-9d02-728dd4dcf5bc None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.296625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ed1403a6-d8dc-44ae-8ae9-d2044a40989f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:07.298733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ed1403a6-d8dc-44ae-8ae9-d2044a40989f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:07.331032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e336c-1e3c-4c51-8a53-d61908f54b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.331859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e336c-1e3c-4c51-8a53-d61908f54b21 None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.332151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e336c-1e3c-4c51-8a53-d61908f54b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.332430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e336c-1e3c-4c51-8a53-d61908f54b21 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/groups/3ffb37cd669b465ba985dbc95f0391c5/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.334489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e336c-1e3c-4c51-8a53-d61908f54b21 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4bff8a4031648c7b2f2ebfdb69f7137, group_id=3ffb37cd669b465ba985dbc95f0391c5, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:07.336016 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e336c-1e3c-4c51-8a53-d61908f54b21 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:07.381934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 193/388] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:07.383207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d6ee8-714b-41ee-bd23-c33528e9c558 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.383454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d6ee8-714b-41ee-bd23-c33528e9c558 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.383722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d6ee8-714b-41ee-bd23-c33528e9c558 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.385223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 194/389] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:07.390822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11190d-c94c-4ff1-956a-3a3f78186553 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.395742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11190d-c94c-4ff1-956a-3a3f78186553 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.395742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11190d-c94c-4ff1-956a-3a3f78186553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.412474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-8e11190d-c94c-4ff1-956a-3a3f78186553 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:07.413751 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8e11190d-c94c-4ff1-956a-3a3f78186553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:07.434567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 196/390] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 31 19:08:07 2022] PUT /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/groups/3ffb37cd669b465ba985dbc95f0391c5/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:07.503112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 195/391] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:08:07.679160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e336c-1e3c-4c51-8a53-d61908f54b21 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.786441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.790372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e336c-1e3c-4c51-8a53-d61908f54b21 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:07.829830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00ffa6-3803-41a6-837c-91d2d035aaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:07.829830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00ffa6-3803-41a6-837c-91d2d035aaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.829830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00ffa6-3803-41a6-837c-91d2d035aaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.829830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00ffa6-3803-41a6-837c-91d2d035aaa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.840660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00ffa6-3803-41a6-837c-91d2d035aaa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-7c00ffa6-3803-41a6-837c-91d2d035aaa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:07.845583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:07.846457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:07.847231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 197/392] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:07.853159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11190d-c94c-4ff1-956a-3a3f78186553 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.875524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.920291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00ffa6-3803-41a6-837c-91d2d035aaa9 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:07.989433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11190d-c94c-4ff1-956a-3a3f78186553 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.111316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679048b-1d9d-4bdd-92bf-7c0bce98572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.111976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679048b-1d9d-4bdd-92bf-7c0bce98572b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.113020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679048b-1d9d-4bdd-92bf-7c0bce98572b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.113451 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679048b-1d9d-4bdd-92bf-7c0bce98572b None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.114631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679048b-1d9d-4bdd-92bf-7c0bce98572b None admin] RBAC: Adding query filter params (name=member) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:08.115100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679048b-1d9d-4bdd-92bf-7c0bce98572b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.117834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679048b-1d9d-4bdd-92bf-7c0bce98572b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.129080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 196/393] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.136088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d87e4-7e9b-4dda-b5a9-353999073d00 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.136373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d87e4-7e9b-4dda-b5a9-353999073d00 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.136645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d87e4-7e9b-4dda-b5a9-353999073d00 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.138942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 197/394] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:08.139496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d87e4-7e9b-4dda-b5a9-353999073d00 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.163192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00ffa6-3803-41a6-837c-91d2d035aaa9 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.209835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fea0f-af92-4844-8579-555b123d2272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.210722 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fea0f-af92-4844-8579-555b123d2272 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.211150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fea0f-af92-4844-8579-555b123d2272 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.211565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fea0f-af92-4844-8579-555b123d2272 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.226938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fea0f-af92-4844-8579-555b123d2272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-2f2fea0f-af92-4844-8579-555b123d2272 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:08.234489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:08.235411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:08.236255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:08.242695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 198/395] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:08.242695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e94550-5e6c-4e82-8b81-cbdd4987b1d9 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.242695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e94550-5e6c-4e82-8b81-cbdd4987b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.242695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e94550-5e6c-4e82-8b81-cbdd4987b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.257971 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.267534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-d7e94550-5e6c-4e82-8b81-cbdd4987b1d9 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:08.269437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d7e94550-5e6c-4e82-8b81-cbdd4987b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:08.283023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d87e4-7e9b-4dda-b5a9-353999073d00 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.289740 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.333843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72067ef0-2c73-4d1f-820c-d460f889b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.334537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72067ef0-2c73-4d1f-820c-d460f889b63a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.334821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72067ef0-2c73-4d1f-820c-d460f889b63a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.335096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72067ef0-2c73-4d1f-820c-d460f889b63a None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.336757 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72067ef0-2c73-4d1f-820c-d460f889b63a None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.338527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72067ef0-2c73-4d1f-820c-d460f889b63a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.345824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 198/396] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.347295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72067ef0-2c73-4d1f-820c-d460f889b63a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.358720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 199/397] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:08.359394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e94550-5e6c-4e82-8b81-cbdd4987b1d9 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.462126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72067ef0-2c73-4d1f-820c-d460f889b63a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.466529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e94550-5e6c-4e82-8b81-cbdd4987b1d9 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.499914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a77845-a230-461d-9b0e-87f4f19448ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.501378 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a77845-a230-461d-9b0e-87f4f19448ed None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.501958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a77845-a230-461d-9b0e-87f4f19448ed None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.502513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a77845-a230-461d-9b0e-87f4f19448ed None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.502838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc1ad-f3ca-4baa-ab99-faa6ef61ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.503473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc1ad-f3ca-4baa-ab99-faa6ef61ef62 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.503755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc1ad-f3ca-4baa-ab99-faa6ef61ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.504041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc1ad-f3ca-4baa-ab99-faa6ef61ef62 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.504947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a77845-a230-461d-9b0e-87f4f19448ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:08.505623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a77845-a230-461d-9b0e-87f4f19448ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.505827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cc1ad-f3ca-4baa-ab99-faa6ef61ef62 None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.507263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cc1ad-f3ca-4baa-ab99-faa6ef61ef62 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.507676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a77845-a230-461d-9b0e-87f4f19448ed None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.509117 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 200/398] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.522634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 199/399] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.523820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc1ad-f3ca-4baa-ab99-faa6ef61ef62 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.530831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a77845-a230-461d-9b0e-87f4f19448ed None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.546229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.564500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.632015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc1ad-f3ca-4baa-ab99-faa6ef61ef62 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.673505 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302d15-888b-48f2-91ca-0e4ec4506910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.674214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302d15-888b-48f2-91ca-0e4ec4506910 None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.674488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302d15-888b-48f2-91ca-0e4ec4506910 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.674765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302d15-888b-48f2-91ca-0e4ec4506910 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd/groups/3ffb37cd669b465ba985dbc95f0391c5/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.679038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71302d15-888b-48f2-91ca-0e4ec4506910 None admin] RBAC: Authorizing `identity:create_grant(project_id=c85373107052445eb6721136e8247abd, group_id=3ffb37cd669b465ba985dbc95f0391c5, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.680475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71302d15-888b-48f2-91ca-0e4ec4506910 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.728714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a77845-a230-461d-9b0e-87f4f19448ed None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.762988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e07cee-38bc-4443-8506-42ca62a25481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.763558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e07cee-38bc-4443-8506-42ca62a25481 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.763843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e07cee-38bc-4443-8506-42ca62a25481 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.764124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e07cee-38bc-4443-8506-42ca62a25481 None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.765296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e07cee-38bc-4443-8506-42ca62a25481 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.766831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e07cee-38bc-4443-8506-42ca62a25481 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.768440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 200/400] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.769567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2d8f-7a46-41d0-bd16-39f71eadef52 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.769949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2d8f-7a46-41d0-bd16-39f71eadef52 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.770231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd2d8f-7a46-41d0-bd16-39f71eadef52 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.773840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 201/401] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:08.773840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd2d8f-7a46-41d0-bd16-39f71eadef52 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.783873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 201/402] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 31 19:08:08 2022] PUT /identity/v3/projects/c85373107052445eb6721136e8247abd/groups/3ffb37cd669b465ba985dbc95f0391c5/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:08:08.783873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302d15-888b-48f2-91ca-0e4ec4506910 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.883583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.910113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.910319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302d15-888b-48f2-91ca-0e4ec4506910 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.943852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd2d8f-7a46-41d0-bd16-39f71eadef52 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.960058 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd99cc-7fd4-47a0-b155-3ae8fd5a9085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.960844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd99cc-7fd4-47a0-b155-3ae8fd5a9085 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.961147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd99cc-7fd4-47a0-b155-3ae8fd5a9085 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.961426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd99cc-7fd4-47a0-b155-3ae8fd5a9085 None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.963009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd99cc-7fd4-47a0-b155-3ae8fd5a9085 None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.964470 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd99cc-7fd4-47a0-b155-3ae8fd5a9085 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.967391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 202/403] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.969113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac3fed-96f0-4742-958f-b8e50f89b514 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.969695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac3fed-96f0-4742-958f-b8e50f89b514 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.969984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac3fed-96f0-4742-958f-b8e50f89b514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.983967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af494da5-1275-4c43-a0ca-dd9b7aa4ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.984629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af494da5-1275-4c43-a0ca-dd9b7aa4ec83 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.985063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af494da5-1275-4c43-a0ca-dd9b7aa4ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.989960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af494da5-1275-4c43-a0ca-dd9b7aa4ec83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.993103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-98ac3fed-96f0-4742-958f-b8e50f89b514 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:08.994405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-98ac3fed-96f0-4742-958f-b8e50f89b514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:09.002759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af494da5-1275-4c43-a0ca-dd9b7aa4ec83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-af494da5-1275-4c43-a0ca-dd9b7aa4ec83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:09.008060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:09.008950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:09.010179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 202/404] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:09.010835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af494da5-1275-4c43-a0ca-dd9b7aa4ec83 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.065825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 203/405] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:09.066467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac3fed-96f0-4742-958f-b8e50f89b514 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.132232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af494da5-1275-4c43-a0ca-dd9b7aa4ec83 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.170576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba7a28-0dd4-42c2-a262-7c44951d119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.171241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba7a28-0dd4-42c2-a262-7c44951d119e None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.171519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba7a28-0dd4-42c2-a262-7c44951d119e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.171794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba7a28-0dd4-42c2-a262-7c44951d119e None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/groups/3ffb37cd669b465ba985dbc95f0391c5/roles/3ba2e6e2ec814831bb3bc254484024d2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.174429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba7a28-0dd4-42c2-a262-7c44951d119e None admin] RBAC: Authorizing `identity:create_grant(project_id=f4bff8a4031648c7b2f2ebfdb69f7137, group_id=3ffb37cd669b465ba985dbc95f0391c5, role_id=3ba2e6e2ec814831bb3bc254484024d2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.175862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba7a28-0dd4-42c2-a262-7c44951d119e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.242192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.253286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac3fed-96f0-4742-958f-b8e50f89b514 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.280033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.284486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 203/406] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 31 19:08:09 2022] PUT /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137/groups/3ffb37cd669b465ba985dbc95f0391c5/roles/3ba2e6e2ec814831bb3bc254484024d2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:09.297082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3700fb-d4c2-4181-9e0a-e7e869499c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.297819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3700fb-d4c2-4181-9e0a-e7e869499c23 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.298102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3700fb-d4c2-4181-9e0a-e7e869499c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.298424 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3700fb-d4c2-4181-9e0a-e7e869499c23 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.299127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3700fb-d4c2-4181-9e0a-e7e869499c23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:09.299432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3700fb-d4c2-4181-9e0a-e7e869499c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.300900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3700fb-d4c2-4181-9e0a-e7e869499c23 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.311202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 204/407] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:09.319831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba7a28-0dd4-42c2-a262-7c44951d119e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.378542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3700fb-d4c2-4181-9e0a-e7e869499c23 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.497947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba7a28-0dd4-42c2-a262-7c44951d119e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.540964 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bfbd8-9643-44a2-82da-f1a474e9cefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.541927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bfbd8-9643-44a2-82da-f1a474e9cefa None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.542347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bfbd8-9643-44a2-82da-f1a474e9cefa None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.542783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bfbd8-9643-44a2-82da-f1a474e9cefa None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.544402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bfbd8-9643-44a2-82da-f1a474e9cefa None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.546354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bfbd8-9643-44a2-82da-f1a474e9cefa None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.548333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 204/408] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:09.554179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bfbd8-9643-44a2-82da-f1a474e9cefa None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.556218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3700fb-d4c2-4181-9e0a-e7e869499c23 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.610372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c412b-81e5-4765-b1ef-1e7df4f72bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.610983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c412b-81e5-4765-b1ef-1e7df4f72bbd None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.611265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c412b-81e5-4765-b1ef-1e7df4f72bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.611536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c412b-81e5-4765-b1ef-1e7df4f72bbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.616907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.634194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c412b-81e5-4765-b1ef-1e7df4f72bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-7a7c412b-81e5-4765-b1ef-1e7df4f72bbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:09.641555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:09.652514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:09.653362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 205/409] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:09.654770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c412b-81e5-4765-b1ef-1e7df4f72bbd None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.664261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.707428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bfbd8-9643-44a2-82da-f1a474e9cefa None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.751321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb7ed-73d5-4d13-b0dd-1d6a3a45f411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.752735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb7ed-73d5-4d13-b0dd-1d6a3a45f411 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.754748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb7ed-73d5-4d13-b0dd-1d6a3a45f411 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.756212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb7ed-73d5-4d13-b0dd-1d6a3a45f411 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.758922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fb7ed-73d5-4d13-b0dd-1d6a3a45f411 None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.760644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fb7ed-73d5-4d13-b0dd-1d6a3a45f411 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.769466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 205/410] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:09.771922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb7ed-73d5-4d13-b0dd-1d6a3a45f411 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.861776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c412b-81e5-4765-b1ef-1e7df4f72bbd None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.909516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823619b1-16a1-4339-b21f-94887d6d5413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.910174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823619b1-16a1-4339-b21f-94887d6d5413 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.910481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823619b1-16a1-4339-b21f-94887d6d5413 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.910765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823619b1-16a1-4339-b21f-94887d6d5413 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.912576 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823619b1-16a1-4339-b21f-94887d6d5413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:09.912890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823619b1-16a1-4339-b21f-94887d6d5413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.914340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823619b1-16a1-4339-b21f-94887d6d5413 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.929770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 206/411] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:09.931485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9c661-50aa-4fee-87ca-ac6c7ac3aadb None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.932001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9c661-50aa-4fee-87ca-ac6c7ac3aadb None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.934099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9c661-50aa-4fee-87ca-ac6c7ac3aadb None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.940644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 207/412] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:09.940644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9c661-50aa-4fee-87ca-ac6c7ac3aadb None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.966371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb7ed-73d5-4d13-b0dd-1d6a3a45f411 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.007552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d211a26-697f-44e1-b235-2b40bae36e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.009022 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211a26-697f-44e1-b235-2b40bae36e02 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.009559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211a26-697f-44e1-b235-2b40bae36e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.010207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211a26-697f-44e1-b235-2b40bae36e02 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd/groups/3ffb37cd669b465ba985dbc95f0391c5/roles/3ba2e6e2ec814831bb3bc254484024d2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.013864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d211a26-697f-44e1-b235-2b40bae36e02 None admin] RBAC: Authorizing `identity:create_grant(project_id=c85373107052445eb6721136e8247abd, group_id=3ffb37cd669b465ba985dbc95f0391c5, role_id=3ba2e6e2ec814831bb3bc254484024d2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.015962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d211a26-697f-44e1-b235-2b40bae36e02 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.021097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.025786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.069004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9c661-50aa-4fee-87ca-ac6c7ac3aadb None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.096589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 206/413] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 31 19:08:09 2022] PUT /identity/v3/projects/c85373107052445eb6721136e8247abd/groups/3ffb37cd669b465ba985dbc95f0391c5/roles/3ba2e6e2ec814831bb3bc254484024d2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:10.098846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eb594-fd32-4877-bc51-83192c4fe65c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.099954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eb594-fd32-4877-bc51-83192c4fe65c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.100567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eb594-fd32-4877-bc51-83192c4fe65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.106032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4fd1c-da98-42dc-a49c-94e2b054d1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.106921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4fd1c-da98-42dc-a49c-94e2b054d1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.113233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4fd1c-da98-42dc-a49c-94e2b054d1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.113233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4fd1c-da98-42dc-a49c-94e2b054d1c6 None admin] PATH_INFO: `/v3/groups/8450ed67dc3b484886933b94f081e2a6` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.113233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4fd1c-da98-42dc-a49c-94e2b054d1c6 None admin] RBAC: Authorizing `identity:get_group(group_id=8450ed67dc3b484886933b94f081e2a6)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.113233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4fd1c-da98-42dc-a49c-94e2b054d1c6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.113233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 208/414] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/groups/8450ed67dc3b484886933b94f081e2a6 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:10.120418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4fd1c-da98-42dc-a49c-94e2b054d1c6 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.126587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-883eb594-fd32-4877-bc51-83192c4fe65c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:10.128291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-883eb594-fd32-4877-bc51-83192c4fe65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:10.272453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 207/415] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:10.299210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4fd1c-da98-42dc-a49c-94e2b054d1c6 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.327376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.336454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be942dd6-d032-4ba6-9996-c77b17382ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.337086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be942dd6-d032-4ba6-9996-c77b17382ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.337442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be942dd6-d032-4ba6-9996-c77b17382ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.337759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be942dd6-d032-4ba6-9996-c77b17382ad5 None admin] PATH_INFO: `/v3/projects/e050b6f9e66f4591994e7fdf0d98777d` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.339108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be942dd6-d032-4ba6-9996-c77b17382ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=e050b6f9e66f4591994e7fdf0d98777d)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.345941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be942dd6-d032-4ba6-9996-c77b17382ad5 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.345941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 209/416] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/projects/e050b6f9e66f4591994e7fdf0d98777d => generated 344 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:10.348585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eb594-fd32-4877-bc51-83192c4fe65c None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.473909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eb594-fd32-4877-bc51-83192c4fe65c None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.507479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.516697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d9690-e0b2-4602-ad2f-4051fa8be374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.523814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d9690-e0b2-4602-ad2f-4051fa8be374 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.523814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d9690-e0b2-4602-ad2f-4051fa8be374 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.523814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d9690-e0b2-4602-ad2f-4051fa8be374 None admin] PATH_INFO: `/v3/projects/e050b6f9e66f4591994e7fdf0d98777d/groups/8450ed67dc3b484886933b94f081e2a6/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.523814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d9690-e0b2-4602-ad2f-4051fa8be374 None admin] RBAC: Authorizing `identity:create_grant(project_id=e050b6f9e66f4591994e7fdf0d98777d, group_id=8450ed67dc3b484886933b94f081e2a6, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.523814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d9690-e0b2-4602-ad2f-4051fa8be374 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.592504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 208/417] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 31 19:08:10 2022] PUT /identity/v3/projects/e050b6f9e66f4591994e7fdf0d98777d/groups/8450ed67dc3b484886933b94f081e2a6/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:08:10.648723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be942dd6-d032-4ba6-9996-c77b17382ad5 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.787719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be942dd6-d032-4ba6-9996-c77b17382ad5 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.829120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9ffb1-962b-4477-817e-ec0d24c53866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.829793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9ffb1-962b-4477-817e-ec0d24c53866 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.830072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9ffb1-962b-4477-817e-ec0d24c53866 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.830344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9ffb1-962b-4477-817e-ec0d24c53866 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.841232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9ffb1-962b-4477-817e-ec0d24c53866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-aae9ffb1-962b-4477-817e-ec0d24c53866 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:10.846630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:10.847518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:10.848367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:10.850855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 210/418] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:10.854061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d9690-e0b2-4602-ad2f-4051fa8be374 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:11.006806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d9690-e0b2-4602-ad2f-4051fa8be374 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.059464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455fb10-bf2a-4f30-964f-66841411527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.060000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455fb10-bf2a-4f30-964f-66841411527b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.060277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455fb10-bf2a-4f30-964f-66841411527b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.060546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455fb10-bf2a-4f30-964f-66841411527b None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.061214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455fb10-bf2a-4f30-964f-66841411527b None admin] RBAC: Adding query filter params (name=member) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:11.061511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455fb10-bf2a-4f30-964f-66841411527b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:11.062903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455fb10-bf2a-4f30-964f-66841411527b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:11.074405 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 209/419] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:11.080000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9ffb1-962b-4477-817e-ec0d24c53866 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:11.105043 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d271a2a-d70d-4bec-bfab-38c95df8c93c None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.105374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d271a2a-d70d-4bec-bfab-38c95df8c93c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.105656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d271a2a-d70d-4bec-bfab-38c95df8c93c None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.107362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 210/420] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:11.112311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239d081-63e0-4843-b3b0-46941dc1a9f1 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.112597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239d081-63e0-4843-b3b0-46941dc1a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.112874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239d081-63e0-4843-b3b0-46941dc1a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.133516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c239d081-63e0-4843-b3b0-46941dc1a9f1 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:11.134785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c239d081-63e0-4843-b3b0-46941dc1a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:11.164339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:11.210715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:11.229578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9ffb1-962b-4477-817e-ec0d24c53866 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.265694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0bf8d-076f-4d29-b610-05605f840074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.266318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0bf8d-076f-4d29-b610-05605f840074 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.266640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0bf8d-076f-4d29-b610-05605f840074 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.266919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0bf8d-076f-4d29-b610-05605f840074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.287375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 211/421] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:08:11.361164 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0bf8d-076f-4d29-b610-05605f840074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:11.362577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0bf8d-076f-4d29-b610-05605f840074 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:11.439375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:11.498690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 211/422] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:11.505307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239d081-63e0-4843-b3b0-46941dc1a9f1 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:11.581415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0bf8d-076f-4d29-b610-05605f840074 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:11.651133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239d081-63e0-4843-b3b0-46941dc1a9f1 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.714118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1f620-9247-4c97-b71a-b002ee88ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.715131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1f620-9247-4c97-b71a-b002ee88ff5a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.715608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1f620-9247-4c97-b71a-b002ee88ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.716102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1f620-9247-4c97-b71a-b002ee88ff5a None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.718253 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1f620-9247-4c97-b71a-b002ee88ff5a None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:11.720781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1f620-9247-4c97-b71a-b002ee88ff5a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:11.722854 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 212/423] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:11 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:11.730849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1f620-9247-4c97-b71a-b002ee88ff5a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:11.759601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0bf8d-076f-4d29-b610-05605f840074 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.814044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:11.830878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f3771-221d-436a-b319-46080c15f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.832042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f3771-221d-436a-b319-46080c15f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.832568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f3771-221d-436a-b319-46080c15f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.833106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f3771-221d-436a-b319-46080c15f0a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.847063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f3771-221d-436a-b319-46080c15f0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-209f3771-221d-436a-b319-46080c15f0a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:11.854606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:11.855593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:08:11.856363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:11.858967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 212/424] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:11.864216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926d8f6-efb0-4e51-8548-101a468b391b None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.864216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926d8f6-efb0-4e51-8548-101a468b391b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.864216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926d8f6-efb0-4e51-8548-101a468b391b None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.864216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 213/425] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:11.868724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926d8f6-efb0-4e51-8548-101a468b391b None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:11.885030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1f620-9247-4c97-b71a-b002ee88ff5a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:11.887354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:11.935187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870544ba-6884-492a-8fc9-975eace3f4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:11.935828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870544ba-6884-492a-8fc9-975eace3f4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.936159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870544ba-6884-492a-8fc9-975eace3f4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.936439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870544ba-6884-492a-8fc9-975eace3f4e8 None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.938199 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870544ba-6884-492a-8fc9-975eace3f4e8 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:11.940211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870544ba-6884-492a-8fc9-975eace3f4e8 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:11.942889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 213/426] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:11 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:11.946947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa549b09-7aa5-4e04-8067-ac2b05c5e414 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:11.947380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa549b09-7aa5-4e04-8067-ac2b05c5e414 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:11.947875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa549b09-7aa5-4e04-8067-ac2b05c5e414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:11.967045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-aa549b09-7aa5-4e04-8067-ac2b05c5e414 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:11.968435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-aa549b09-7aa5-4e04-8067-ac2b05c5e414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:12.007011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926d8f6-efb0-4e51-8548-101a468b391b None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.051256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 214/427] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:12.052380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa549b09-7aa5-4e04-8067-ac2b05c5e414 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.066765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab90fda-d9b1-4887-85f7-daf34c67f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.067448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab90fda-d9b1-4887-85f7-daf34c67f748 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.067725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab90fda-d9b1-4887-85f7-daf34c67f748 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.067997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab90fda-d9b1-4887-85f7-daf34c67f748 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.068777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab90fda-d9b1-4887-85f7-daf34c67f748 None admin] RBAC: Adding query filter params (name=member) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:12.069187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab90fda-d9b1-4887-85f7-daf34c67f748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:12.072619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab90fda-d9b1-4887-85f7-daf34c67f748 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:12.091100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 214/428] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:08:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:12.097477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab90fda-d9b1-4887-85f7-daf34c67f748 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.147299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.233538 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.246039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa549b09-7aa5-4e04-8067-ac2b05c5e414 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.277078 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab90fda-d9b1-4887-85f7-daf34c67f748 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.307693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450dea-5e54-4eb5-b8b4-39b110bb9071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.308366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450dea-5e54-4eb5-b8b4-39b110bb9071 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.308567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450dea-5e54-4eb5-b8b4-39b110bb9071 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.308838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450dea-5e54-4eb5-b8b4-39b110bb9071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.309816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7450dea-5e54-4eb5-b8b4-39b110bb9071 None admin] RBAC: Adding query filter params (group.id=3ffb37cd669b465ba985dbc95f0391c5, role.id=d1bf17fdde744527bb5905634f0b1b2c, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:12.310121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7450dea-5e54-4eb5-b8b4-39b110bb9071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:12.311559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7450dea-5e54-4eb5-b8b4-39b110bb9071 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:12.319164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 215/429] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/role_assignments?group.id=3ffb37cd669b465ba985dbc95f0391c5&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 611 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:12.328394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadf70-8c2d-46d1-aade-f46a65241a38 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.328680 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadf70-8c2d-46d1-aade-f46a65241a38 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.328964 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dadf70-8c2d-46d1-aade-f46a65241a38 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.330673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 216/430] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:12.336326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e589d-5fea-42a9-a9c0-fdb5427da8c2 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.336635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e589d-5fea-42a9-a9c0-fdb5427da8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.336860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e589d-5fea-42a9-a9c0-fdb5427da8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.337698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ab892-b692-4edf-a0c2-2913598d2ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.338624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ab892-b692-4edf-a0c2-2913598d2ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.339350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ab892-b692-4edf-a0c2-2913598d2ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.339823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ab892-b692-4edf-a0c2-2913598d2ed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.356081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-922e589d-5fea-42a9-a9c0-fdb5427da8c2 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:12.357387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-922e589d-5fea-42a9-a9c0-fdb5427da8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:12.430769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ab892-b692-4edf-a0c2-2913598d2ed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:12.432854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ab892-b692-4edf-a0c2-2913598d2ed8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:12.453300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 217/431] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:08:12.454612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e589d-5fea-42a9-a9c0-fdb5427da8c2 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.528360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.567173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.601172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 215/432] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:12.607490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ab892-b692-4edf-a0c2-2913598d2ed8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.608721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e589d-5fea-42a9-a9c0-fdb5427da8c2 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.654616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cb496-465a-47c0-ab24-a02f126b1439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.655280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cb496-465a-47c0-ab24-a02f126b1439 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.655559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cb496-465a-47c0-ab24-a02f126b1439 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.655833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cb496-465a-47c0-ab24-a02f126b1439 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.669649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cb496-465a-47c0-ab24-a02f126b1439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-878cb496-465a-47c0-ab24-a02f126b1439 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:12.674704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:12.675622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:12.677400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 218/433] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:12.682420 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cb496-465a-47c0-ab24-a02f126b1439 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.755226 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ab892-b692-4edf-a0c2-2913598d2ed8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.805195 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d0bbd-4ded-4468-a8ee-07a5dfa6f113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.805811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d0bbd-4ded-4468-a8ee-07a5dfa6f113 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.806064 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d0bbd-4ded-4468-a8ee-07a5dfa6f113 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.806324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d0bbd-4ded-4468-a8ee-07a5dfa6f113 None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.807466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d0bbd-4ded-4468-a8ee-07a5dfa6f113 None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:12.808915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d0bbd-4ded-4468-a8ee-07a5dfa6f113 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:12.810966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 216/434] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:12.814380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d0bbd-4ded-4468-a8ee-07a5dfa6f113 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.841652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.848681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cb496-465a-47c0-ab24-a02f126b1439 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.884329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.897180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f81bd-c44d-4556-8c3b-dfd63c4b4c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.897829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f81bd-c44d-4556-8c3b-dfd63c4b4c1d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.898114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f81bd-c44d-4556-8c3b-dfd63c4b4c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.898392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f81bd-c44d-4556-8c3b-dfd63c4b4c1d None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.899071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f81bd-c44d-4556-8c3b-dfd63c4b4c1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:12.899376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f81bd-c44d-4556-8c3b-dfd63c4b4c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:12.900746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f81bd-c44d-4556-8c3b-dfd63c4b4c1d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:12.915990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 219/435] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:12.916848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f81bd-c44d-4556-8c3b-dfd63c4b4c1d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.953642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d0bbd-4ded-4468-a8ee-07a5dfa6f113 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:12.991346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f5a33-4ce3-4960-8ead-099b99595d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:12.991986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f5a33-4ce3-4960-8ead-099b99595d70 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.992267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f5a33-4ce3-4960-8ead-099b99595d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.992545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f5a33-4ce3-4960-8ead-099b99595d70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.003004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f5a33-4ce3-4960-8ead-099b99595d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-163f5a33-4ce3-4960-8ead-099b99595d70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:13.007924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:13.014463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 217/436] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:13.015243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f5a33-4ce3-4960-8ead-099b99595d70 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.031436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f81bd-c44d-4556-8c3b-dfd63c4b4c1d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.066066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec59baf-ecea-449b-adff-9bfd89a73aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.066611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec59baf-ecea-449b-adff-9bfd89a73aac None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.066889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec59baf-ecea-449b-adff-9bfd89a73aac None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.067160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec59baf-ecea-449b-adff-9bfd89a73aac None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.068259 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec59baf-ecea-449b-adff-9bfd89a73aac None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.069713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec59baf-ecea-449b-adff-9bfd89a73aac None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.071520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 220/437] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:13.072613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8cd33-95f6-4ffd-aa27-750d689e1f1c None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.072899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8cd33-95f6-4ffd-aa27-750d689e1f1c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.073155 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8cd33-95f6-4ffd-aa27-750d689e1f1c None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.074602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 221/438] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:13.075178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8cd33-95f6-4ffd-aa27-750d689e1f1c None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.105360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.116419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f5a33-4ce3-4960-8ead-099b99595d70 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.121886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.151036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47595c1-4fe9-410e-8b87-09b84c2064a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.151752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47595c1-4fe9-410e-8b87-09b84c2064a9 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.152041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47595c1-4fe9-410e-8b87-09b84c2064a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.152315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47595c1-4fe9-410e-8b87-09b84c2064a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.178979 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8cd33-95f6-4ffd-aa27-750d689e1f1c None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.212790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2759-e423-4c04-8434-1920d64129c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.213504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2759-e423-4c04-8434-1920d64129c3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.213829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2759-e423-4c04-8434-1920d64129c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.214111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2759-e423-4c04-8434-1920d64129c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.214879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea2759-e423-4c04-8434-1920d64129c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:13.215072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea2759-e423-4c04-8434-1920d64129c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.216445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea2759-e423-4c04-8434-1920d64129c3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.220384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47595c1-4fe9-410e-8b87-09b84c2064a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.221832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47595c1-4fe9-410e-8b87-09b84c2064a9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.224410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 222/439] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:13.225210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2759-e423-4c04-8434-1920d64129c3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.313706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.323781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2759-e423-4c04-8434-1920d64129c3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.324981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 218/440] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:13.326063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec122-180d-41eb-9e80-18cca1ed9c65 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.326347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec122-180d-41eb-9e80-18cca1ed9c65 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.326625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec122-180d-41eb-9e80-18cca1ed9c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.334619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.345198 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-306ec122-180d-41eb-9e80-18cca1ed9c65 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:13.346425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-306ec122-180d-41eb-9e80-18cca1ed9c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:13.358159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4684b43-089f-401a-8888-4a49d103c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.358764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4684b43-089f-401a-8888-4a49d103c75f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.359045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4684b43-089f-401a-8888-4a49d103c75f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.359344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4684b43-089f-401a-8888-4a49d103c75f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.360061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4684b43-089f-401a-8888-4a49d103c75f None admin] RBAC: Adding query filter params (group.id=3ffb37cd669b465ba985dbc95f0391c5, role.id=d1bf17fdde744527bb5905634f0b1b2c, scope.project.id=c85373107052445eb6721136e8247abd) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:13.360365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4684b43-089f-401a-8888-4a49d103c75f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.361957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4684b43-089f-401a-8888-4a49d103c75f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.367723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 223/441] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/role_assignments?group.id=3ffb37cd669b465ba985dbc95f0391c5&scope.project.id=c85373107052445eb6721136e8247abd&role.id=d1bf17fdde744527bb5905634f0b1b2c => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:13.368588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4684b43-089f-401a-8888-4a49d103c75f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.426271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 219/442] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:13.426271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec122-180d-41eb-9e80-18cca1ed9c65 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.503125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4684b43-089f-401a-8888-4a49d103c75f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.550510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa537fa-96e8-4311-946a-f3000d8e5d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.551777 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa537fa-96e8-4311-946a-f3000d8e5d83 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.552078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa537fa-96e8-4311-946a-f3000d8e5d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.552349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa537fa-96e8-4311-946a-f3000d8e5d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.568702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec122-180d-41eb-9e80-18cca1ed9c65 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.590118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.613054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a363-1772-4cfe-ad7b-f5df47fd34fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.614575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a363-1772-4cfe-ad7b-f5df47fd34fc None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.614575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a363-1772-4cfe-ad7b-f5df47fd34fc None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.614819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a363-1772-4cfe-ad7b-f5df47fd34fc None admin] PATH_INFO: `/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.616040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129a363-1772-4cfe-ad7b-f5df47fd34fc None admin] RBAC: Authorizing `identity:get_project(project_id=f4bff8a4031648c7b2f2ebfdb69f7137)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.617573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129a363-1772-4cfe-ad7b-f5df47fd34fc None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.619241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 220/443] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/projects/f4bff8a4031648c7b2f2ebfdb69f7137 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:13.624894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a363-1772-4cfe-ad7b-f5df47fd34fc None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.627978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.639285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa537fa-96e8-4311-946a-f3000d8e5d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.640673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa537fa-96e8-4311-946a-f3000d8e5d83 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.732700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a363-1772-4cfe-ad7b-f5df47fd34fc None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.742649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 224/444] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:13.743799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa537fa-96e8-4311-946a-f3000d8e5d83 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.767124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d2f04-2d24-4532-a950-3a03b8767c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.767752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2f04-2d24-4532-a950-3a03b8767c64 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.768028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2f04-2d24-4532-a950-3a03b8767c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.768309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2f04-2d24-4532-a950-3a03b8767c64 None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.769414 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d2f04-2d24-4532-a950-3a03b8767c64 None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.770895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d2f04-2d24-4532-a950-3a03b8767c64 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.772447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 221/445] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:13.773192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d2f04-2d24-4532-a950-3a03b8767c64 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.797596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.845338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa537fa-96e8-4311-946a-f3000d8e5d83 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.850420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.879028 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13577aad-899e-4af1-844a-da3589704694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.880310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13577aad-899e-4af1-844a-da3589704694 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.880582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13577aad-899e-4af1-844a-da3589704694 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.880849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13577aad-899e-4af1-844a-da3589704694 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.881324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d2f04-2d24-4532-a950-3a03b8767c64 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.891082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13577aad-899e-4af1-844a-da3589704694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-13577aad-899e-4af1-844a-da3589704694 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:13.897126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:13.898126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:13.898880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 225/446] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:13.899524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13577aad-899e-4af1-844a-da3589704694 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.920017 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6d0d3-8161-4c2b-936d-7bf4b019953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.920644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6d0d3-8161-4c2b-936d-7bf4b019953c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.920923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6d0d3-8161-4c2b-936d-7bf4b019953c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.921223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6d0d3-8161-4c2b-936d-7bf4b019953c None admin] PATH_INFO: `/v3/projects/c85373107052445eb6721136e8247abd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.922347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6d0d3-8161-4c2b-936d-7bf4b019953c None admin] RBAC: Authorizing `identity:get_project(project_id=c85373107052445eb6721136e8247abd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.923756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6d0d3-8161-4c2b-936d-7bf4b019953c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.925357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 222/447] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/projects/c85373107052445eb6721136e8247abd => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:13.926729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6d0d3-8161-4c2b-936d-7bf4b019953c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.999295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13577aad-899e-4af1-844a-da3589704694 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.013421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.026486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6d0d3-8161-4c2b-936d-7bf4b019953c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.035351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdd28d-39b5-4da6-a48f-0f86b54054c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.036289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdd28d-39b5-4da6-a48f-0f86b54054c6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.036570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdd28d-39b5-4da6-a48f-0f86b54054c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.036847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdd28d-39b5-4da6-a48f-0f86b54054c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.037644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdd28d-39b5-4da6-a48f-0f86b54054c6 None admin] RBAC: Adding query filter params (group.id=3ffb37cd669b465ba985dbc95f0391c5, role.id=3ba2e6e2ec814831bb3bc254484024d2, scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:14.037913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdd28d-39b5-4da6-a48f-0f86b54054c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.039368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdd28d-39b5-4da6-a48f-0f86b54054c6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.045363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 226/448] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/role_assignments?group.id=3ffb37cd669b465ba985dbc95f0391c5&scope.project.id=f4bff8a4031648c7b2f2ebfdb69f7137&role.id=3ba2e6e2ec814831bb3bc254484024d2 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:14.046184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdd28d-39b5-4da6-a48f-0f86b54054c6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.065235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e409a37-92e3-4b00-a0a3-bc359a36afd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.067163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409a37-92e3-4b00-a0a3-bc359a36afd5 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.067638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409a37-92e3-4b00-a0a3-bc359a36afd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.068062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e409a37-92e3-4b00-a0a3-bc359a36afd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.068927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e409a37-92e3-4b00-a0a3-bc359a36afd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:14.069393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e409a37-92e3-4b00-a0a3-bc359a36afd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.071950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e409a37-92e3-4b00-a0a3-bc359a36afd5 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.079224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.085259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 223/449] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:14.091103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e409a37-92e3-4b00-a0a3-bc359a36afd5 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.166207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdd28d-39b5-4da6-a48f-0f86b54054c6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.206865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fa044-9be5-407f-a942-b6ccf8f5d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.207090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e409a37-92e3-4b00-a0a3-bc359a36afd5 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.208130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fa044-9be5-407f-a942-b6ccf8f5d49e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.208414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fa044-9be5-407f-a942-b6ccf8f5d49e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.208698 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fa044-9be5-407f-a942-b6ccf8f5d49e None admin] PATH_INFO: `/v3/groups/3ffb37cd669b465ba985dbc95f0391c5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.209925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fa044-9be5-407f-a942-b6ccf8f5d49e None admin] RBAC: Authorizing `identity:get_group(group_id=3ffb37cd669b465ba985dbc95f0391c5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.211360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fa044-9be5-407f-a942-b6ccf8f5d49e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.212951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 227/450] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/groups/3ffb37cd669b465ba985dbc95f0391c5 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:14.218934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fa044-9be5-407f-a942-b6ccf8f5d49e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.246686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dec62-c395-48d4-87ef-1f1f1d54b43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.247299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dec62-c395-48d4-87ef-1f1f1d54b43c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.247607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dec62-c395-48d4-87ef-1f1f1d54b43c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.247857 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368dec62-c395-48d4-87ef-1f1f1d54b43c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.272314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.327638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.330778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368dec62-c395-48d4-87ef-1f1f1d54b43c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.332349 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368dec62-c395-48d4-87ef-1f1f1d54b43c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.336311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fa044-9be5-407f-a942-b6ccf8f5d49e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.376929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23323b0c-27b1-44b7-8851-dad88c350d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.377550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23323b0c-27b1-44b7-8851-dad88c350d26 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.377896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23323b0c-27b1-44b7-8851-dad88c350d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.378178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23323b0c-27b1-44b7-8851-dad88c350d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.378921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23323b0c-27b1-44b7-8851-dad88c350d26 None admin] RBAC: Adding query filter params (group.id=3ffb37cd669b465ba985dbc95f0391c5, role.id=3ba2e6e2ec814831bb3bc254484024d2, scope.project.id=c85373107052445eb6721136e8247abd) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:14.379782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23323b0c-27b1-44b7-8851-dad88c350d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.381448 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23323b0c-27b1-44b7-8851-dad88c350d26 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.388470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 228/451] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/role_assignments?group.id=3ffb37cd669b465ba985dbc95f0391c5&scope.project.id=c85373107052445eb6721136e8247abd&role.id=3ba2e6e2ec814831bb3bc254484024d2 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:14.451809 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 224/452] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:08:14.458041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23323b0c-27b1-44b7-8851-dad88c350d26 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.578534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23323b0c-27b1-44b7-8851-dad88c350d26 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.589602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.612622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a1732-4530-4296-8ebe-31a3f893ea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.613246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a1732-4530-4296-8ebe-31a3f893ea11 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.619845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a1732-4530-4296-8ebe-31a3f893ea11 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.619845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a1732-4530-4296-8ebe-31a3f893ea11 None admin] PATH_INFO: `/v3/projects/e050b6f9e66f4591994e7fdf0d98777d` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.619845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a1732-4530-4296-8ebe-31a3f893ea11 None admin] RBAC: Authorizing `identity:get_project(project_id=e050b6f9e66f4591994e7fdf0d98777d)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.619845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a1732-4530-4296-8ebe-31a3f893ea11 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.619845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 229/453] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/projects/e050b6f9e66f4591994e7fdf0d98777d => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:14.624368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dec62-c395-48d4-87ef-1f1f1d54b43c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.721324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.726040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368dec62-c395-48d4-87ef-1f1f1d54b43c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.760932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c9a28-4a0b-47f6-9ef6-44546b0bab3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.761564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c9a28-4a0b-47f6-9ef6-44546b0bab3a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.761869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c9a28-4a0b-47f6-9ef6-44546b0bab3a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.762146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c9a28-4a0b-47f6-9ef6-44546b0bab3a None admin] PATH_INFO: `/v3/groups/8450ed67dc3b484886933b94f081e2a6` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.763248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c9a28-4a0b-47f6-9ef6-44546b0bab3a None admin] RBAC: Authorizing `identity:get_group(group_id=8450ed67dc3b484886933b94f081e2a6)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.764673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c9a28-4a0b-47f6-9ef6-44546b0bab3a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.766268 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 225/454] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/groups/8450ed67dc3b484886933b94f081e2a6 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:14.772274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a1732-4530-4296-8ebe-31a3f893ea11 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.870756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a1732-4530-4296-8ebe-31a3f893ea11 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.902467 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf660f5-cf93-4401-abe4-412922375ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.903058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf660f5-cf93-4401-abe4-412922375ebc None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.903338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf660f5-cf93-4401-abe4-412922375ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.903612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf660f5-cf93-4401-abe4-412922375ebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.904332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf660f5-cf93-4401-abe4-412922375ebc None admin] RBAC: Adding query filter params (group.id=8450ed67dc3b484886933b94f081e2a6, role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=e050b6f9e66f4591994e7fdf0d98777d) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:14.904644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf660f5-cf93-4401-abe4-412922375ebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.906112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf660f5-cf93-4401-abe4-412922375ebc None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.912240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 230/455] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/role_assignments?group.id=8450ed67dc3b484886933b94f081e2a6&scope.project.id=e050b6f9e66f4591994e7fdf0d98777d&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:17.257533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea3fa7-6f13-4a5b-a8b1-cb46cb6c4e73 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.258083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea3fa7-6f13-4a5b-a8b1-cb46cb6c4e73 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.258158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea3fa7-6f13-4a5b-a8b1-cb46cb6c4e73 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.259737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 226/456] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:17.264797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eea83-a09e-4fd1-8238-97596f5005ca None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.265194 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eea83-a09e-4fd1-8238-97596f5005ca None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.265386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eea83-a09e-4fd1-8238-97596f5005ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.294732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-122eea83-a09e-4fd1-8238-97596f5005ca None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:17.295950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-122eea83-a09e-4fd1-8238-97596f5005ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:17.342262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.386716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 231/457] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:17.850125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bac67-12ed-4b7e-9004-c693f67d2ce2 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.850411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bac67-12ed-4b7e-9004-c693f67d2ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.850691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bac67-12ed-4b7e-9004-c693f67d2ce2 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.852471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 227/458] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:17.857357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0110cc-4d8d-40e7-a960-f598e2af3647 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.857820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0110cc-4d8d-40e7-a960-f598e2af3647 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.858195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0110cc-4d8d-40e7-a960-f598e2af3647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.886682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-8c0110cc-4d8d-40e7-a960-f598e2af3647 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:17.888034 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8c0110cc-4d8d-40e7-a960-f598e2af3647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:17.900970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68233c92-86ca-4a01-8e5d-f0f72a526f91 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.902957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68233c92-86ca-4a01-8e5d-f0f72a526f91 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.902957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68233c92-86ca-4a01-8e5d-f0f72a526f91 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.903517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 228/459] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:17.911139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55a92-a7e0-46e8-a43b-bd36be799d1b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.911709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55a92-a7e0-46e8-a43b-bd36be799d1b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.912209 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55a92-a7e0-46e8-a43b-bd36be799d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.947158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-01b55a92-a7e0-46e8-a43b-bd36be799d1b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:17.947158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-01b55a92-a7e0-46e8-a43b-bd36be799d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:18.001933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 232/460] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:18.003132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0110cc-4d8d-40e7-a960-f598e2af3647 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.024637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 229/461] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:18.026248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bd987-83b7-4fea-b428-410cfc34b930 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.026733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bd987-83b7-4fea-b428-410cfc34b930 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.027556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bd987-83b7-4fea-b428-410cfc34b930 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.033226 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 230/462] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:18.034960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8eac75-e26b-4cd4-b6bf-cf46e68b0166 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.035494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8eac75-e26b-4cd4-b6bf-cf46e68b0166 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.035970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8eac75-e26b-4cd4-b6bf-cf46e68b0166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.056715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3d8eac75-e26b-4cd4-b6bf-cf46e68b0166 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:18.058299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3d8eac75-e26b-4cd4-b6bf-cf46e68b0166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:18.152342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 231/463] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:18.274436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0110cc-4d8d-40e7-a960-f598e2af3647 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.276055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.316484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9f20a-5e04-4dec-a92d-1c7a13012599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.317717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9f20a-5e04-4dec-a92d-1c7a13012599 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.318002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9f20a-5e04-4dec-a92d-1c7a13012599 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.318272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9f20a-5e04-4dec-a92d-1c7a13012599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.337283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9f20a-5e04-4dec-a92d-1c7a13012599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.338751 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9f20a-5e04-4dec-a92d-1c7a13012599 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-3bb9f20a-5e04-4dec-a92d-1c7a13012599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:18.356394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:18.357324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:18.358245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:18.358245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:18.358245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:18.358245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 233/464] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:18.365658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8eac75-e26b-4cd4-b6bf-cf46e68b0166 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.373381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9f20a-5e04-4dec-a92d-1c7a13012599 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.407319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.492483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8eac75-e26b-4cd4-b6bf-cf46e68b0166 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.513514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9f20a-5e04-4dec-a92d-1c7a13012599 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.532549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746124-2ab2-4b43-a43a-6d7999a49a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.533162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746124-2ab2-4b43-a43a-6d7999a49a33 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.533445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746124-2ab2-4b43-a43a-6d7999a49a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.533750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746124-2ab2-4b43-a43a-6d7999a49a33 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.534409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a746124-2ab2-4b43-a43a-6d7999a49a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:18.534719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a746124-2ab2-4b43-a43a-6d7999a49a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.536642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a746124-2ab2-4b43-a43a-6d7999a49a33 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.548194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 232/465] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:18.549030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746124-2ab2-4b43-a43a-6d7999a49a33 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.560186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434127-dd21-4c2c-82be-7d20faf5ac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.560821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434127-dd21-4c2c-82be-7d20faf5ac2f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.561100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434127-dd21-4c2c-82be-7d20faf5ac2f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.561375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434127-dd21-4c2c-82be-7d20faf5ac2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.572622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3434127-dd21-4c2c-82be-7d20faf5ac2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.574116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3434127-dd21-4c2c-82be-7d20faf5ac2f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b3434127-dd21-4c2c-82be-7d20faf5ac2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:18.588350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:18.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:18.590081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:18.590081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:18.590081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:18.590694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 234/466] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:18.591358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434127-dd21-4c2c-82be-7d20faf5ac2f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.600989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.640865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.652267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746124-2ab2-4b43-a43a-6d7999a49a33 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.686635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f47f1e-892c-4da3-8c5b-bfbc228299d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.687251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47f1e-892c-4da3-8c5b-bfbc228299d7 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.687522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47f1e-892c-4da3-8c5b-bfbc228299d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.687800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47f1e-892c-4da3-8c5b-bfbc228299d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.691625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434127-dd21-4c2c-82be-7d20faf5ac2f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.698796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f47f1e-892c-4da3-8c5b-bfbc228299d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.700336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f47f1e-892c-4da3-8c5b-bfbc228299d7 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-c2f47f1e-892c-4da3-8c5b-bfbc228299d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:18.714621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:18.715805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:18.716753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:18.716753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:18.716753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:18.716753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 233/467] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:18.717109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57308920-d4b2-4261-9b2d-a8c494d8dc71 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.717377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57308920-d4b2-4261-9b2d-a8c494d8dc71 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.717694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57308920-d4b2-4261-9b2d-a8c494d8dc71 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.718931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 234/468] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:18.719607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57308920-d4b2-4261-9b2d-a8c494d8dc71 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.730594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd8564-45d7-42ad-a003-eda4805ae027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.731233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd8564-45d7-42ad-a003-eda4805ae027 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.731515 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd8564-45d7-42ad-a003-eda4805ae027 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.731791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd8564-45d7-42ad-a003-eda4805ae027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.743362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd8564-45d7-42ad-a003-eda4805ae027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.744822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd8564-45d7-42ad-a003-eda4805ae027 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-ffdd8564-45d7-42ad-a003-eda4805ae027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:18.759333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:18.760242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:18.761046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:18.761046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:18.761046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:18.761046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 235/469] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:18.761644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd8564-45d7-42ad-a003-eda4805ae027 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.820180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.826173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57308920-d4b2-4261-9b2d-a8c494d8dc71 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.861610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4d84f-9016-40f0-a501-c3485fd937d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.862267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4d84f-9016-40f0-a501-c3485fd937d2 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.862544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4d84f-9016-40f0-a501-c3485fd937d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.862813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4d84f-9016-40f0-a501-c3485fd937d2 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.863131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd8564-45d7-42ad-a003-eda4805ae027 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.863484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4d84f-9016-40f0-a501-c3485fd937d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.864899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4d84f-9016-40f0-a501-c3485fd937d2 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.876438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.896263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d517-ada3-485e-b26c-e8ba4941e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.896888 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d517-ada3-485e-b26c-e8ba4941e61e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.897158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d517-ada3-485e-b26c-e8ba4941e61e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.897436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d517-ada3-485e-b26c-e8ba4941e61e None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.898121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4d517-ada3-485e-b26c-e8ba4941e61e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:18.898454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4d517-ada3-485e-b26c-e8ba4941e61e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.899827 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4d517-ada3-485e-b26c-e8ba4941e61e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.917350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 236/470] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:18.918184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d517-ada3-485e-b26c-e8ba4941e61e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.952441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 235/471] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:08:18 2022] POST /identity/v3/users => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:18.953601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa935f0-d313-4b0f-8f8e-2d751e2d2adb None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.953981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa935f0-d313-4b0f-8f8e-2d751e2d2adb None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.954326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa935f0-d313-4b0f-8f8e-2d751e2d2adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.975634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-0fa935f0-d313-4b0f-8f8e-2d751e2d2adb None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:18.976864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0fa935f0-d313-4b0f-8f8e-2d751e2d2adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:19.032978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d517-ada3-485e-b26c-e8ba4941e61e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.054513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:19.056290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 236/472] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:19.057162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa935f0-d313-4b0f-8f8e-2d751e2d2adb None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.082729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382dc4f-b243-46b6-ad5d-b19ac23d6c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.083368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382dc4f-b243-46b6-ad5d-b19ac23d6c57 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.083657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382dc4f-b243-46b6-ad5d-b19ac23d6c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.083941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382dc4f-b243-46b6-ad5d-b19ac23d6c57 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.084631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382dc4f-b243-46b6-ad5d-b19ac23d6c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:19.084984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382dc4f-b243-46b6-ad5d-b19ac23d6c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.086693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382dc4f-b243-46b6-ad5d-b19ac23d6c57 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.104652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 237/473] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:19.105832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382dc4f-b243-46b6-ad5d-b19ac23d6c57 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.199813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa935f0-d313-4b0f-8f8e-2d751e2d2adb None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.233222 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382dc4f-b243-46b6-ad5d-b19ac23d6c57 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.235422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:19.248278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a13a5-3b22-46dc-9c1f-fbdd43b715a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.253372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a13a5-3b22-46dc-9c1f-fbdd43b715a3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.253372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a13a5-3b22-46dc-9c1f-fbdd43b715a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.253372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a13a5-3b22-46dc-9c1f-fbdd43b715a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.253372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a13a5-3b22-46dc-9c1f-fbdd43b715a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:19.253372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a13a5-3b22-46dc-9c1f-fbdd43b715a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.253945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a13a5-3b22-46dc-9c1f-fbdd43b715a3 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.270762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 237/474] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:19.271855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a13a5-3b22-46dc-9c1f-fbdd43b715a3 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.272206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b54ad-3b85-4821-b2a6-78e5bba0c8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.272954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b54ad-3b85-4821-b2a6-78e5bba0c8d2 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.273213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b54ad-3b85-4821-b2a6-78e5bba0c8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.273533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b54ad-3b85-4821-b2a6-78e5bba0c8d2 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.274221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b54ad-3b85-4821-b2a6-78e5bba0c8d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.275915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b54ad-3b85-4821-b2a6-78e5bba0c8d2 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.365712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 238/475] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:08:19 2022] POST /identity/v3/users => generated 249 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:19.365712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b54ad-3b85-4821-b2a6-78e5bba0c8d2 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.397413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a13a5-3b22-46dc-9c1f-fbdd43b715a3 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.401316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:19.447167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58974c-9b23-4999-aa36-bb24c3e26b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.447888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58974c-9b23-4999-aa36-bb24c3e26b7d None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.448174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58974c-9b23-4999-aa36-bb24c3e26b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.448453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58974c-9b23-4999-aa36-bb24c3e26b7d None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.449846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58974c-9b23-4999-aa36-bb24c3e26b7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.451784 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58974c-9b23-4999-aa36-bb24c3e26b7d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.479994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b54ad-3b85-4821-b2a6-78e5bba0c8d2 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.525715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177e066-d4b4-4da1-a47d-f7b8ae8a8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.526314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177e066-d4b4-4da1-a47d-f7b8ae8a8571 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.533823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177e066-d4b4-4da1-a47d-f7b8ae8a8571 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.533823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177e066-d4b4-4da1-a47d-f7b8ae8a8571 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.533823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177e066-d4b4-4da1-a47d-f7b8ae8a8571 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.533823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177e066-d4b4-4da1-a47d-f7b8ae8a8571 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.554169 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 238/476] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:08:19 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:19.555741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58974c-9b23-4999-aa36-bb24c3e26b7d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.605931 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 239/477] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:08:19 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:19.610308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:19.701081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58974c-9b23-4999-aa36-bb24c3e26b7d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:19.742974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf2048-d1bf-498a-a460-026174d7013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:19.743604 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf2048-d1bf-498a-a460-026174d7013a None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:19.743885 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf2048-d1bf-498a-a460-026174d7013a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:19.744161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf2048-d1bf-498a-a460-026174d7013a None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:19.744853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf2048-d1bf-498a-a460-026174d7013a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:19.746428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf2048-d1bf-498a-a460-026174d7013a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:19.808956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.sql.core [None req-6cdf2048-d1bf-498a-a460-026174d7013a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 19:08:19.808956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 19:08:19.808956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [parameters: {'id': '941e5f039d0e4b0e89fdcb3f7ba50647', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 19:08:19.808956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81728) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-6cdf2048-d1bf-498a-a460-026174d7013a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application result.read() Aug 31 19:08:19.829698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:08:19.830618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application yield resource Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise self.value Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application session.commit() Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 19:08:19.831495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self.session.flush() Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application compat.raise_( Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 19:08:19.832381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:08:19.833285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application result.read() Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:08:19.835966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [parameters: {'id': '941e5f039d0e4b0e89fdcb3f7ba50647', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:19.837892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 19:08:19.839166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:19.840007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 239/478] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 31 19:08:19 2022] POST /identity/v3/roles => generated 144 bytes in 274 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:19.840078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177e066-d4b4-4da1-a47d-f7b8ae8a8571 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:19.953302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:19.964724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177e066-d4b4-4da1-a47d-f7b8ae8a8571 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:20.005925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe399c-f5d7-4ffb-be9e-90c4318335cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:20.006835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe399c-f5d7-4ffb-be9e-90c4318335cd None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.007276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe399c-f5d7-4ffb-be9e-90c4318335cd None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.007801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe399c-f5d7-4ffb-be9e-90c4318335cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.018872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe399c-f5d7-4ffb-be9e-90c4318335cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-5bfe399c-f5d7-4ffb-be9e-90c4318335cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:20.024090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:20.025349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:08:20.026353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:20.028701 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 240/479] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:08:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:20.034353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf2048-d1bf-498a-a460-026174d7013a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:20.245412 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf2048-d1bf-498a-a460-026174d7013a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:20.252923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:20.288256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53a8df-9a1a-4065-a4d9-4a9d955666aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:20.289041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53a8df-9a1a-4065-a4d9-4a9d955666aa None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.289717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53a8df-9a1a-4065-a4d9-4a9d955666aa None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.290015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53a8df-9a1a-4065-a4d9-4a9d955666aa None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.290763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53a8df-9a1a-4065-a4d9-4a9d955666aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:20.291068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53a8df-9a1a-4065-a4d9-4a9d955666aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:20.292436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53a8df-9a1a-4065-a4d9-4a9d955666aa None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:20.301886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 240/480] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:21.160956 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889460c-a4e3-499d-9e55-46de63aad081 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.161972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889460c-a4e3-499d-9e55-46de63aad081 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.162463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889460c-a4e3-499d-9e55-46de63aad081 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.164024 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 241/481] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:21.169335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0cae9-0b86-4043-9450-a87ca31138c2 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.170152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0cae9-0b86-4043-9450-a87ca31138c2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.170628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0cae9-0b86-4043-9450-a87ca31138c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.194209 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-5fc0cae9-0b86-4043-9450-a87ca31138c2 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:21.196085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-5fc0cae9-0b86-4043-9450-a87ca31138c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:21.274608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 241/482] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:21.637447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889460c-a4e3-499d-9e55-46de63aad081 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.774343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889460c-a4e3-499d-9e55-46de63aad081 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:21.828276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f94fad-21d6-4037-ab71-3d0b5a42ad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:21.829230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f94fad-21d6-4037-ab71-3d0b5a42ad62 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.829745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f94fad-21d6-4037-ab71-3d0b5a42ad62 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.830216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f94fad-21d6-4037-ab71-3d0b5a42ad62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.849173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f94fad-21d6-4037-ab71-3d0b5a42ad62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-84f94fad-21d6-4037-ab71-3d0b5a42ad62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:21.855137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:21.856030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:21.856802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:21.859141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 242/483] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:21.865157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0cae9-0b86-4043-9450-a87ca31138c2 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.867083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bdde2-67fa-46d8-baec-cccbdd459888 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.867369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bdde2-67fa-46d8-baec-cccbdd459888 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.867644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bdde2-67fa-46d8-baec-cccbdd459888 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.868966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 243/484] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:21.883290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4d94-fa22-4b0d-944f-b0d436906628 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.883587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4d94-fa22-4b0d-944f-b0d436906628 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.883843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4d94-fa22-4b0d-944f-b0d436906628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.906054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e46a4d94-fa22-4b0d-944f-b0d436906628 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:21.907180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e46a4d94-fa22-4b0d-944f-b0d436906628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:21.910179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:21.991040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:21.995291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0cae9-0b86-4043-9450-a87ca31138c2 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.016351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 244/485] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:08:22.017728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf1c4-a47a-467d-88d4-0a8780250edc None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.018020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf1c4-a47a-467d-88d4-0a8780250edc None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.018300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf1c4-a47a-467d-88d4-0a8780250edc None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.024546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 245/486] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:22.026646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b8a9-0cc0-44e6-b2f6-55de91aa029c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.026928 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b8a9-0cc0-44e6-b2f6-55de91aa029c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.027201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516b8a9-0cc0-44e6-b2f6-55de91aa029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.046414 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a06cea-2426-4e24-aae1-0e5af06ddb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.047039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06cea-2426-4e24-aae1-0e5af06ddb64 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.047318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06cea-2426-4e24-aae1-0e5af06ddb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.047588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06cea-2426-4e24-aae1-0e5af06ddb64 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.048267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a06cea-2426-4e24-aae1-0e5af06ddb64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:22.048592 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a06cea-2426-4e24-aae1-0e5af06ddb64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.049984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a06cea-2426-4e24-aae1-0e5af06ddb64 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.060636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1516b8a9-0cc0-44e6-b2f6-55de91aa029c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:22.061875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1516b8a9-0cc0-44e6-b2f6-55de91aa029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:22.074219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 242/487] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:22.075305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a06cea-2426-4e24-aae1-0e5af06ddb64 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.193157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 246/488] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:22.215084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a06cea-2426-4e24-aae1-0e5af06ddb64 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.217953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2719c8-8704-43b1-81a1-207a8d9b7391 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.218243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2719c8-8704-43b1-81a1-207a8d9b7391 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.218521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2719c8-8704-43b1-81a1-207a8d9b7391 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.219856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 247/489] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:22.234131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a35a7-c7e6-4ec0-9839-d6df58d9e373 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.234428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a35a7-c7e6-4ec0-9839-d6df58d9e373 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.234684 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a35a7-c7e6-4ec0-9839-d6df58d9e373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.249888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac0df-d238-464f-b70f-42b04e5d08be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.250524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac0df-d238-464f-b70f-42b04e5d08be None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.250804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac0df-d238-464f-b70f-42b04e5d08be None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.251077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac0df-d238-464f-b70f-42b04e5d08be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.262664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac0df-d238-464f-b70f-42b04e5d08be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.264106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac0df-d238-464f-b70f-42b04e5d08be None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.278643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-141a35a7-c7e6-4ec0-9839-d6df58d9e373 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-56eac0df-d238-464f-b70f-42b04e5d08be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:22.279095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:22.281095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:22.283135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:22.283135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:22.283135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:22.283552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-141a35a7-c7e6-4ec0-9839-d6df58d9e373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:22.283722 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 243/490] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:22.285976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac0df-d238-464f-b70f-42b04e5d08be None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.300937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.374504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.381494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 248/491] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:08:22.386687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a35a7-c7e6-4ec0-9839-d6df58d9e373 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.406262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac0df-d238-464f-b70f-42b04e5d08be None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.470036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1e5c5-0df6-4ded-8727-e01e97ef6f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.470563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e5c5-0df6-4ded-8727-e01e97ef6f71 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.470847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e5c5-0df6-4ded-8727-e01e97ef6f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.471124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e5c5-0df6-4ded-8727-e01e97ef6f71 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.471833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1e5c5-0df6-4ded-8727-e01e97ef6f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:22.472215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1e5c5-0df6-4ded-8727-e01e97ef6f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.473658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1e5c5-0df6-4ded-8727-e01e97ef6f71 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.497914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 244/492] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:22.503190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1e5c5-0df6-4ded-8727-e01e97ef6f71 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.565785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a35a7-c7e6-4ec0-9839-d6df58d9e373 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.590932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.604972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8d376-8a74-470b-b576-3426293d7211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.605853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8d376-8a74-470b-b576-3426293d7211 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.606276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8d376-8a74-470b-b576-3426293d7211 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.606693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8d376-8a74-470b-b576-3426293d7211 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.624838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8d376-8a74-470b-b576-3426293d7211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-67d8d376-8a74-470b-b576-3426293d7211 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:22.630323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:22.631183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:22.631966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 249/493] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:22.632595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8d376-8a74-470b-b576-3426293d7211 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.638113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1e5c5-0df6-4ded-8727-e01e97ef6f71 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.677725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66360dc-93e7-4122-b6da-90f6ead42098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.678932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66360dc-93e7-4122-b6da-90f6ead42098 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.679406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66360dc-93e7-4122-b6da-90f6ead42098 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.679888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66360dc-93e7-4122-b6da-90f6ead42098 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.688634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66360dc-93e7-4122-b6da-90f6ead42098 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.690462 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66360dc-93e7-4122-b6da-90f6ead42098 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.699671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-d66360dc-93e7-4122-b6da-90f6ead42098 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:22.705522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:22.707021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:22.709294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:22.709294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:22.709294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:22.709294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:22.709294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:22.709294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:22.709294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:22.709294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:22.709294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:22.709294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:22.715545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 245/494] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:22.715545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66360dc-93e7-4122-b6da-90f6ead42098 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.750123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8d376-8a74-470b-b576-3426293d7211 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.790078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656854d0-e181-4b09-892a-694060d01d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.790930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656854d0-e181-4b09-892a-694060d01d05 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.791328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656854d0-e181-4b09-892a-694060d01d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.791687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656854d0-e181-4b09-892a-694060d01d05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.804905 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656854d0-e181-4b09-892a-694060d01d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-656854d0-e181-4b09-892a-694060d01d05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:22.810442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:22.811511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:22.812485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:22.819856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 250/495] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:22.821051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656854d0-e181-4b09-892a-694060d01d05 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.832074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66360dc-93e7-4122-b6da-90f6ead42098 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.864498 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.870144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e26b-962e-47a3-9a16-0d04e67e0a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.871149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e26b-962e-47a3-9a16-0d04e67e0a69 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.871589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e26b-962e-47a3-9a16-0d04e67e0a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.871869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e26b-962e-47a3-9a16-0d04e67e0a69 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.872546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25e26b-962e-47a3-9a16-0d04e67e0a69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:22.872852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25e26b-962e-47a3-9a16-0d04e67e0a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:22.874249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25e26b-962e-47a3-9a16-0d04e67e0a69 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:22.883909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 246/496] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:22.884540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e26b-962e-47a3-9a16-0d04e67e0a69 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.936049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656854d0-e181-4b09-892a-694060d01d05 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:22.957153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:22.972348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcdc71-f63b-4df0-aeed-5d01af4f17d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:22.973530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcdc71-f63b-4df0-aeed-5d01af4f17d6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:22.973882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcdc71-f63b-4df0-aeed-5d01af4f17d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:22.974150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcdc71-f63b-4df0-aeed-5d01af4f17d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:22.984384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcdc71-f63b-4df0-aeed-5d01af4f17d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-00fcdc71-f63b-4df0-aeed-5d01af4f17d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:22.990158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:22.991097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:22.991887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 251/497] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:22.993145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcdc71-f63b-4df0-aeed-5d01af4f17d6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:22.994510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e26b-962e-47a3-9a16-0d04e67e0a69 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.029229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5213e-5590-4eae-8a1a-8a31bf1730a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.029758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5213e-5590-4eae-8a1a-8a31bf1730a7 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.030040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5213e-5590-4eae-8a1a-8a31bf1730a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.030340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5213e-5590-4eae-8a1a-8a31bf1730a7 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.031070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5213e-5590-4eae-8a1a-8a31bf1730a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.031371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5213e-5590-4eae-8a1a-8a31bf1730a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.032792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5213e-5590-4eae-8a1a-8a31bf1730a7 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.069820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 247/498] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:23.070908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5213e-5590-4eae-8a1a-8a31bf1730a7 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.100885 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcdc71-f63b-4df0-aeed-5d01af4f17d6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.128302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.136319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861466a-a627-446e-87b8-f2243df3f626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.136935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861466a-a627-446e-87b8-f2243df3f626 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.137191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861466a-a627-446e-87b8-f2243df3f626 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.137466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861466a-a627-446e-87b8-f2243df3f626 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.138151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861466a-a627-446e-87b8-f2243df3f626 None admin] RBAC: Adding query filter params (name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.138483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861466a-a627-446e-87b8-f2243df3f626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.139860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861466a-a627-446e-87b8-f2243df3f626 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.147829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 252/499] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:23.149060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0314d35-f8cb-42d8-8ae4-2b93b1c12c88 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.149346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0314d35-f8cb-42d8-8ae4-2b93b1c12c88 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.149621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0314d35-f8cb-42d8-8ae4-2b93b1c12c88 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.151066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 253/500] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:23.151632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0314d35-f8cb-42d8-8ae4-2b93b1c12c88 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.178821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5213e-5590-4eae-8a1a-8a31bf1730a7 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.199066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.213242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22a61-07cb-457d-a614-a4fbd1bc1fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.213910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22a61-07cb-457d-a614-a4fbd1bc1fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.214197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22a61-07cb-457d-a614-a4fbd1bc1fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.214474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22a61-07cb-457d-a614-a4fbd1bc1fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.224569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea22a61-07cb-457d-a614-a4fbd1bc1fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.226070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea22a61-07cb-457d-a614-a4fbd1bc1fa9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-9ea22a61-07cb-457d-a614-a4fbd1bc1fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:23.240618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:23.241517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:23.242577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:23.242577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:23.242577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:23.242577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 248/501] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:23.242577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22a61-07cb-457d-a614-a4fbd1bc1fa9 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.261843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0314d35-f8cb-42d8-8ae4-2b93b1c12c88 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.296358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7104f17-73ff-408e-a464-2ed09d481787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.296985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7104f17-73ff-408e-a464-2ed09d481787 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.297332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7104f17-73ff-408e-a464-2ed09d481787 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.297730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7104f17-73ff-408e-a464-2ed09d481787 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.298404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7104f17-73ff-408e-a464-2ed09d481787 None admin] RBAC: Adding query filter params (name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.298718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7104f17-73ff-408e-a464-2ed09d481787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.300105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7104f17-73ff-408e-a464-2ed09d481787 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.308720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 254/502] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:23.309720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a09e7-b648-49ac-a696-714196a68b6c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.310010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a09e7-b648-49ac-a696-714196a68b6c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.310341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a09e7-b648-49ac-a696-714196a68b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.328725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-0a8a09e7-b648-49ac-a696-714196a68b6c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:23.329954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0a8a09e7-b648-49ac-a696-714196a68b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:23.348811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22a61-07cb-457d-a614-a4fbd1bc1fa9 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.351191 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.383296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692076f6-ffa4-4f1f-8da2-8386d3fd9041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.383901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692076f6-ffa4-4f1f-8da2-8386d3fd9041 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.384183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692076f6-ffa4-4f1f-8da2-8386d3fd9041 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.384461 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692076f6-ffa4-4f1f-8da2-8386d3fd9041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.399460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 255/503] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:23.400358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a09e7-b648-49ac-a696-714196a68b6c None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.455063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.458478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692076f6-ffa4-4f1f-8da2-8386d3fd9041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.459948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692076f6-ffa4-4f1f-8da2-8386d3fd9041 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.541897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a09e7-b648-49ac-a696-714196a68b6c None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.569420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 249/504] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:23.570633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692076f6-ffa4-4f1f-8da2-8386d3fd9041 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.576383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.583772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f26f0-9f99-467e-99a2-601ed91d9747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.584403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f26f0-9f99-467e-99a2-601ed91d9747 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.584688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f26f0-9f99-467e-99a2-601ed91d9747 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.584963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f26f0-9f99-467e-99a2-601ed91d9747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.595477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f26f0-9f99-467e-99a2-601ed91d9747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.596916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f26f0-9f99-467e-99a2-601ed91d9747 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-aa2f26f0-9f99-467e-99a2-601ed91d9747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:23.611773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:23.612965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:23.614314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:23.614314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:23.614314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:23.614314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 256/505] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:23.614314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f26f0-9f99-467e-99a2-601ed91d9747 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.679705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692076f6-ffa4-4f1f-8da2-8386d3fd9041 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.710367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.712643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901358f-421b-4df9-b5bd-c399c98942e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.713368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901358f-421b-4df9-b5bd-c399c98942e7 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.713646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901358f-421b-4df9-b5bd-c399c98942e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.713946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901358f-421b-4df9-b5bd-c399c98942e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.714588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901358f-421b-4df9-b5bd-c399c98942e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.714890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901358f-421b-4df9-b5bd-c399c98942e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.716268 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901358f-421b-4df9-b5bd-c399c98942e7 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.724966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f26f0-9f99-467e-99a2-601ed91d9747 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.728958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 250/506] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:23.729797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901358f-421b-4df9-b5bd-c399c98942e7 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.758622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b2435-3f20-4b3c-9657-e09e0ff4e16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.759252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b2435-3f20-4b3c-9657-e09e0ff4e16f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.759526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b2435-3f20-4b3c-9657-e09e0ff4e16f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.759797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b2435-3f20-4b3c-9657-e09e0ff4e16f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.769767 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b2435-3f20-4b3c-9657-e09e0ff4e16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.771203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b2435-3f20-4b3c-9657-e09e0ff4e16f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-7e1b2435-3f20-4b3c-9657-e09e0ff4e16f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:23.786068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:23.786949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:23.787768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:23.787768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:23.787768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:23.787768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 257/507] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:23.787987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b2435-3f20-4b3c-9657-e09e0ff4e16f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.796681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.836270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901358f-421b-4df9-b5bd-c399c98942e7 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.869623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250690-4e25-4fb2-8f42-d9d28eddd475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.870282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250690-4e25-4fb2-8f42-d9d28eddd475 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.870563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250690-4e25-4fb2-8f42-d9d28eddd475 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.870831 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250690-4e25-4fb2-8f42-d9d28eddd475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.882289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4250690-4e25-4fb2-8f42-d9d28eddd475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.883747 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4250690-4e25-4fb2-8f42-d9d28eddd475 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.890722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b2435-3f20-4b3c-9657-e09e0ff4e16f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-e4250690-4e25-4fb2-8f42-d9d28eddd475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:23.899015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:23.899870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:23.900735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:23.900735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:23.900735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:23.900735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 251/508] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:23.901835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250690-4e25-4fb2-8f42-d9d28eddd475 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.924902 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6137a0-3365-45bc-8591-31419311d853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:23.925533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6137a0-3365-45bc-8591-31419311d853 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.926393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6137a0-3365-45bc-8591-31419311d853 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.926666 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6137a0-3365-45bc-8591-31419311d853 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.927314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6137a0-3365-45bc-8591-31419311d853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:23.927619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6137a0-3365-45bc-8591-31419311d853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:23.928987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6137a0-3365-45bc-8591-31419311d853 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:23.935915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.940768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 258/509] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:23.941584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6137a0-3365-45bc-8591-31419311d853 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.005638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250690-4e25-4fb2-8f42-d9d28eddd475 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.022275 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.041863 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de8a0e-bd4c-4525-82be-e94c357e7e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.042485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de8a0e-bd4c-4525-82be-e94c357e7e1c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.042763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de8a0e-bd4c-4525-82be-e94c357e7e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.043032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de8a0e-bd4c-4525-82be-e94c357e7e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.043512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6137a0-3365-45bc-8591-31419311d853 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.053341 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de8a0e-bd4c-4525-82be-e94c357e7e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.054843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de8a0e-bd4c-4525-82be-e94c357e7e1c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-30de8a0e-bd4c-4525-82be-e94c357e7e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:24.069509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:24.070768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:24.071616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:24.071616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:24.071616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:24.071616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 252/510] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:24.071976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de8a0e-bd4c-4525-82be-e94c357e7e1c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.081629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62601108-d061-4c8e-a3b9-9eca3b0f2575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.082749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62601108-d061-4c8e-a3b9-9eca3b0f2575 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.083060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62601108-d061-4c8e-a3b9-9eca3b0f2575 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.083331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62601108-d061-4c8e-a3b9-9eca3b0f2575 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.090483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62601108-d061-4c8e-a3b9-9eca3b0f2575 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.091925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62601108-d061-4c8e-a3b9-9eca3b0f2575 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-62601108-d061-4c8e-a3b9-9eca3b0f2575 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:24.105248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:24.113035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 259/511] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:24.113973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62601108-d061-4c8e-a3b9-9eca3b0f2575 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.168025 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.177188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de8a0e-bd4c-4525-82be-e94c357e7e1c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.210763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e68a3-1e71-417d-81bf-a75c26c8cd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.210972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62601108-d061-4c8e-a3b9-9eca3b0f2575 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.211375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e68a3-1e71-417d-81bf-a75c26c8cd6b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.211626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e68a3-1e71-417d-81bf-a75c26c8cd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.211903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e68a3-1e71-417d-81bf-a75c26c8cd6b None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.212542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e68a3-1e71-417d-81bf-a75c26c8cd6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:24.212844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e68a3-1e71-417d-81bf-a75c26c8cd6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.214293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e68a3-1e71-417d-81bf-a75c26c8cd6b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.226843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 253/512] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:24.227647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e68a3-1e71-417d-81bf-a75c26c8cd6b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.244850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660762d-c9e8-4c99-8a7d-7ce34a864294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.245446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660762d-c9e8-4c99-8a7d-7ce34a864294 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.245754 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660762d-c9e8-4c99-8a7d-7ce34a864294 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.246029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660762d-c9e8-4c99-8a7d-7ce34a864294 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.246662 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660762d-c9e8-4c99-8a7d-7ce34a864294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:24.246960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660762d-c9e8-4c99-8a7d-7ce34a864294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.248320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660762d-c9e8-4c99-8a7d-7ce34a864294 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.255185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.259678 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 260/513] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:24.260449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660762d-c9e8-4c99-8a7d-7ce34a864294 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.330196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e68a3-1e71-417d-81bf-a75c26c8cd6b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.360669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660762d-c9e8-4c99-8a7d-7ce34a864294 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.363875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c84318-f6fd-4a39-bab6-cae352e84ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.364504 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c84318-f6fd-4a39-bab6-cae352e84ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.364789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c84318-f6fd-4a39-bab6-cae352e84ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.365067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c84318-f6fd-4a39-bab6-cae352e84ac4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.372135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c84318-f6fd-4a39-bab6-cae352e84ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.373561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c84318-f6fd-4a39-bab6-cae352e84ac4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.377487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-86c84318-f6fd-4a39-bab6-cae352e84ac4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:24.384873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:24.395120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 254/514] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:24.396232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c84318-f6fd-4a39-bab6-cae352e84ac4 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.396990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed654-9adc-4b86-8754-3c99e6e707f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.396990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed654-9adc-4b86-8754-3c99e6e707f3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.396990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed654-9adc-4b86-8754-3c99e6e707f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.397259 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed654-9adc-4b86-8754-3c99e6e707f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.397941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ed654-9adc-4b86-8754-3c99e6e707f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:24.398238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ed654-9adc-4b86-8754-3c99e6e707f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.399586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ed654-9adc-4b86-8754-3c99e6e707f3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.411331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 261/515] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:24.412133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed654-9adc-4b86-8754-3c99e6e707f3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.473724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.485467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c84318-f6fd-4a39-bab6-cae352e84ac4 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.510051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed654-9adc-4b86-8754-3c99e6e707f3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.518790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34bbf7-6652-48ad-8135-04856bd33a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.519399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34bbf7-6652-48ad-8135-04856bd33a1a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.520320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34bbf7-6652-48ad-8135-04856bd33a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.520638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34bbf7-6652-48ad-8135-04856bd33a1a None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.521385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34bbf7-6652-48ad-8135-04856bd33a1a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:24.521717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34bbf7-6652-48ad-8135-04856bd33a1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.523181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34bbf7-6652-48ad-8135-04856bd33a1a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.540929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 255/516] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:24.541795 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34bbf7-6652-48ad-8135-04856bd33a1a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.544667 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a11095-9e02-4c19-9f7a-478c0766a7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.545512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11095-9e02-4c19-9f7a-478c0766a7ee None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.545990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11095-9e02-4c19-9f7a-478c0766a7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.546336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11095-9e02-4c19-9f7a-478c0766a7ee None admin] PATH_INFO: `/v3/users/glance` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.554250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a11095-9e02-4c19-9f7a-478c0766a7ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.555682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a11095-9e02-4c19-9f7a-478c0766a7ee None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-85a11095-9e02-4c19-9f7a-478c0766a7ee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:24.567333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:24.568402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 262/517] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:24.569267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a11095-9e02-4c19-9f7a-478c0766a7ee None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.607677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.645759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34bbf7-6652-48ad-8135-04856bd33a1a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.667383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a11095-9e02-4c19-9f7a-478c0766a7ee None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.678464 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0776d-565e-43d1-9901-1097de5b729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.679089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0776d-565e-43d1-9901-1097de5b729f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.679369 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0776d-565e-43d1-9901-1097de5b729f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.679645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0776d-565e-43d1-9901-1097de5b729f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.686353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0776d-565e-43d1-9901-1097de5b729f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.687792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0776d-565e-43d1-9901-1097de5b729f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-7ce0776d-565e-43d1-9901-1097de5b729f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:24.700096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:24.701192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:24.702250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:24.702250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:24.702250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:24.702250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:24.702250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:24.702250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:24.702250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:24.702250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:24.702735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57b6e8-fcf5-439f-9773-bcf232a907f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.702735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57b6e8-fcf5-439f-9773-bcf232a907f1 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.702735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57b6e8-fcf5-439f-9773-bcf232a907f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.702735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57b6e8-fcf5-439f-9773-bcf232a907f1 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.703015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57b6e8-fcf5-439f-9773-bcf232a907f1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:24.703015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57b6e8-fcf5-439f-9773-bcf232a907f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.704100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57b6e8-fcf5-439f-9773-bcf232a907f1 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.705873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 256/518] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:24.706727 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0776d-565e-43d1-9901-1097de5b729f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.715699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.741933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 263/519] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:24.742766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57b6e8-fcf5-439f-9773-bcf232a907f1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.808796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0776d-565e-43d1-9901-1097de5b729f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.841151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.842922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ec73a-d362-46d8-a78a-e45ea4218a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.843524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ec73a-d362-46d8-a78a-e45ea4218a8c None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.843801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ec73a-d362-46d8-a78a-e45ea4218a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.844314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ec73a-d362-46d8-a78a-e45ea4218a8c None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.844710 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ec73a-d362-46d8-a78a-e45ea4218a8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.846163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ec73a-d362-46d8-a78a-e45ea4218a8c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.846924 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57b6e8-fcf5-439f-9773-bcf232a907f1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.882759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8991a-bee8-465e-ba24-d60101f0a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.883357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8991a-bee8-465e-ba24-d60101f0a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.883633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8991a-bee8-465e-ba24-d60101f0a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.883902 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8991a-bee8-465e-ba24-d60101f0a4b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.939950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 257/520] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:08:24 2022] POST /identity/v3/users => generated 247 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:24.940777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ec73a-d362-46d8-a78a-e45ea4218a8c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:24.956288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8991a-bee8-465e-ba24-d60101f0a4b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.958000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8991a-bee8-465e-ba24-d60101f0a4b4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.015344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.057711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ec73a-d362-46d8-a78a-e45ea4218a8c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.065713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.073781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 264/521] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:25.079661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8991a-bee8-465e-ba24-d60101f0a4b4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.102572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65869760-5fb8-428f-8b79-ea41b9ed6b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.103879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65869760-5fb8-428f-8b79-ea41b9ed6b5a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.103879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65869760-5fb8-428f-8b79-ea41b9ed6b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.103879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65869760-5fb8-428f-8b79-ea41b9ed6b5a None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.104543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65869760-5fb8-428f-8b79-ea41b9ed6b5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:25.104834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65869760-5fb8-428f-8b79-ea41b9ed6b5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.106298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65869760-5fb8-428f-8b79-ea41b9ed6b5a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.129452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 258/522] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 31 19:08:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:25.130483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65869760-5fb8-428f-8b79-ea41b9ed6b5a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.203602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8991a-bee8-465e-ba24-d60101f0a4b4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.241782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a75ad-1616-48ba-83a1-12fb9a3da45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.242432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a75ad-1616-48ba-83a1-12fb9a3da45a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.242677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a75ad-1616-48ba-83a1-12fb9a3da45a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.242951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a75ad-1616-48ba-83a1-12fb9a3da45a None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.243642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a75ad-1616-48ba-83a1-12fb9a3da45a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:25.243944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a75ad-1616-48ba-83a1-12fb9a3da45a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.245377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a75ad-1616-48ba-83a1-12fb9a3da45a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.254950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65869760-5fb8-428f-8b79-ea41b9ed6b5a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.267507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 265/523] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:25.267507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a75ad-1616-48ba-83a1-12fb9a3da45a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.279123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.294054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0efd7f-3051-4fd0-a577-19127f6b103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.294661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0efd7f-3051-4fd0-a577-19127f6b103c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.294940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0efd7f-3051-4fd0-a577-19127f6b103c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.295213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0efd7f-3051-4fd0-a577-19127f6b103c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.329697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.370331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0efd7f-3051-4fd0-a577-19127f6b103c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.371813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0efd7f-3051-4fd0-a577-19127f6b103c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.377779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a75ad-1616-48ba-83a1-12fb9a3da45a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.413625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd06cf-cf50-4e0f-b1a5-99ccc8776963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.414380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd06cf-cf50-4e0f-b1a5-99ccc8776963 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.414660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd06cf-cf50-4e0f-b1a5-99ccc8776963 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.414928 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd06cf-cf50-4e0f-b1a5-99ccc8776963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.427929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd06cf-cf50-4e0f-b1a5-99ccc8776963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.429072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd06cf-cf50-4e0f-b1a5-99ccc8776963 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b9cd06cf-cf50-4e0f-b1a5-99ccc8776963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:25.443370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:25.444300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:25.445111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:25.445111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:25.445111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:25.445111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 266/524] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:25.445565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd06cf-cf50-4e0f-b1a5-99ccc8776963 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.483447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 259/525] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:25.484224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0efd7f-3051-4fd0-a577-19127f6b103c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.506464 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.581304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd06cf-cf50-4e0f-b1a5-99ccc8776963 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.589939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0efd7f-3051-4fd0-a577-19127f6b103c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.593217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.620007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f72a61-da5b-4a20-a0aa-c17dfb00b30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.620957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72a61-da5b-4a20-a0aa-c17dfb00b30a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.621629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72a61-da5b-4a20-a0aa-c17dfb00b30a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.621934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72a61-da5b-4a20-a0aa-c17dfb00b30a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.626320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019a2e-3e37-4a0f-a6d2-e8423d65e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.626922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019a2e-3e37-4a0f-a6d2-e8423d65e43b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.627200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019a2e-3e37-4a0f-a6d2-e8423d65e43b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.627489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019a2e-3e37-4a0f-a6d2-e8423d65e43b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.628193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019a2e-3e37-4a0f-a6d2-e8423d65e43b None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=799cbde43a3643a4beef892d23145112) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:25.628659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019a2e-3e37-4a0f-a6d2-e8423d65e43b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.630068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019a2e-3e37-4a0f-a6d2-e8423d65e43b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.645956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 260/526] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/role_assignments?user.id=799cbde43a3643a4beef892d23145112&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:25.645956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019a2e-3e37-4a0f-a6d2-e8423d65e43b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.716132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f72a61-da5b-4a20-a0aa-c17dfb00b30a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.717609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f72a61-da5b-4a20-a0aa-c17dfb00b30a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.753395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.771020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019a2e-3e37-4a0f-a6d2-e8423d65e43b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:25.821570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70989ba4-0103-4c1d-b85a-7e14a8808115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:25.822316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70989ba4-0103-4c1d-b85a-7e14a8808115 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.823092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70989ba4-0103-4c1d-b85a-7e14a8808115 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.823092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70989ba4-0103-4c1d-b85a-7e14a8808115 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.823549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70989ba4-0103-4c1d-b85a-7e14a8808115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:25.823859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70989ba4-0103-4c1d-b85a-7e14a8808115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:25.825237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70989ba4-0103-4c1d-b85a-7e14a8808115 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:25.841769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 261/527] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:25.842932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70989ba4-0103-4c1d-b85a-7e14a8808115 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.875004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 267/528] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:25.876696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f72a61-da5b-4a20-a0aa-c17dfb00b30a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:25.891799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:25.986011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70989ba4-0103-4c1d-b85a-7e14a8808115 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.021893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f72a61-da5b-4a20-a0aa-c17dfb00b30a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.024682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714377c5-ea1f-4bfb-8cd4-da2644ec8ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.025633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714377c5-ea1f-4bfb-8cd4-da2644ec8ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.026192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714377c5-ea1f-4bfb-8cd4-da2644ec8ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.026782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714377c5-ea1f-4bfb-8cd4-da2644ec8ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.039120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714377c5-ea1f-4bfb-8cd4-da2644ec8ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.040946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714377c5-ea1f-4bfb-8cd4-da2644ec8ad6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.044348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.056898 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7e0a1-93e6-453b-adba-dc5d587b7957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.057533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7e0a1-93e6-453b-adba-dc5d587b7957 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.057843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7e0a1-93e6-453b-adba-dc5d587b7957 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.058118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7e0a1-93e6-453b-adba-dc5d587b7957 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-714377c5-ea1f-4bfb-8cd4-da2644ec8ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:26.060089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:26.061160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:26.062196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:26.062196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:26.062196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:26.064005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 262/529] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:26.065208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714377c5-ea1f-4bfb-8cd4-da2644ec8ad6 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.065598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7e0a1-93e6-453b-adba-dc5d587b7957 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.067594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7e0a1-93e6-453b-adba-dc5d587b7957 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-f4f7e0a1-93e6-453b-adba-dc5d587b7957 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:26.083196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:26.084125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:26.084961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:26.084961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:26.084961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:26.084961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:26.084961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:26.084961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:26.084961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:26.084961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:26.092130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 268/530] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:26.093344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7e0a1-93e6-453b-adba-dc5d587b7957 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.178143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.193684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714377c5-ea1f-4bfb-8cd4-da2644ec8ad6 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.213584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7e0a1-93e6-453b-adba-dc5d587b7957 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.244298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75133f9c-272c-4903-ac91-09c69e2955b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.244939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75133f9c-272c-4903-ac91-09c69e2955b4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.245278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75133f9c-272c-4903-ac91-09c69e2955b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.245933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75133f9c-272c-4903-ac91-09c69e2955b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.253686 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d2b36-4c29-44b1-8f1b-e8d79454a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.255455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d2b36-4c29-44b1-8f1b-e8d79454a7fc None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.255936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d2b36-4c29-44b1-8f1b-e8d79454a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.256428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d2b36-4c29-44b1-8f1b-e8d79454a7fc None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.257277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d2b36-4c29-44b1-8f1b-e8d79454a7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.257811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d2b36-4c29-44b1-8f1b-e8d79454a7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.259437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d2b36-4c29-44b1-8f1b-e8d79454a7fc None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.260043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75133f9c-272c-4903-ac91-09c69e2955b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.261565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75133f9c-272c-4903-ac91-09c69e2955b4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.273929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 269/531] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.275132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d2b36-4c29-44b1-8f1b-e8d79454a7fc None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-75133f9c-272c-4903-ac91-09c69e2955b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:26.280839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:26.281807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:26.282661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:26.282661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:26.282661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:26.285776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 263/532] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:26.286620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75133f9c-272c-4903-ac91-09c69e2955b4 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.355075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.389365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d2b36-4c29-44b1-8f1b-e8d79454a7fc None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.424817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.430917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75133f9c-272c-4903-ac91-09c69e2955b4 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.434085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53a3c5-a887-4f31-bf66-7c0bf9da772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.434928 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53a3c5-a887-4f31-bf66-7c0bf9da772f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.438542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53a3c5-a887-4f31-bf66-7c0bf9da772f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.438542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53a3c5-a887-4f31-bf66-7c0bf9da772f None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.438542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53a3c5-a887-4f31-bf66-7c0bf9da772f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.438542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53a3c5-a887-4f31-bf66-7c0bf9da772f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.438542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53a3c5-a887-4f31-bf66-7c0bf9da772f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.452117 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 270/533] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.457983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53a3c5-a887-4f31-bf66-7c0bf9da772f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.472643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181c718-24ba-4ae2-b269-5f8c0fd34b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.473311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181c718-24ba-4ae2-b269-5f8c0fd34b59 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.473853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181c718-24ba-4ae2-b269-5f8c0fd34b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.474143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181c718-24ba-4ae2-b269-5f8c0fd34b59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.482903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181c718-24ba-4ae2-b269-5f8c0fd34b59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.484906 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181c718-24ba-4ae2-b269-5f8c0fd34b59 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-e181c718-24ba-4ae2-b269-5f8c0fd34b59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:26.501336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:26.502288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:26.503114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:26.503114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:26.503114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:26.503114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:26.503114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:26.503114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:26.503114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:26.503114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:26.503114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 264/534] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:26.503666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181c718-24ba-4ae2-b269-5f8c0fd34b59 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.593448 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53a3c5-a887-4f31-bf66-7c0bf9da772f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.629697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181c718-24ba-4ae2-b269-5f8c0fd34b59 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.633343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b472d9-8c19-4baa-a63d-2ea1cadca751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.634111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b472d9-8c19-4baa-a63d-2ea1cadca751 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.635053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b472d9-8c19-4baa-a63d-2ea1cadca751 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.635356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b472d9-8c19-4baa-a63d-2ea1cadca751 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.636021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b472d9-8c19-4baa-a63d-2ea1cadca751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.636327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b472d9-8c19-4baa-a63d-2ea1cadca751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.637334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.639546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b472d9-8c19-4baa-a63d-2ea1cadca751 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.656016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 271/535] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.662437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b472d9-8c19-4baa-a63d-2ea1cadca751 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.671596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea56b7b-8a01-4c01-a719-60c6cb44ae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.672231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea56b7b-8a01-4c01-a719-60c6cb44ae41 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.672515 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea56b7b-8a01-4c01-a719-60c6cb44ae41 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.673148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea56b7b-8a01-4c01-a719-60c6cb44ae41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.674248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea56b7b-8a01-4c01-a719-60c6cb44ae41 None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=b263d1092fc148129020ba73f2b8fbd3) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.674623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea56b7b-8a01-4c01-a719-60c6cb44ae41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.676420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea56b7b-8a01-4c01-a719-60c6cb44ae41 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.683713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 265/536] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/role_assignments?user.id=b263d1092fc148129020ba73f2b8fbd3&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.685071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea56b7b-8a01-4c01-a719-60c6cb44ae41 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.754643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.819448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea56b7b-8a01-4c01-a719-60c6cb44ae41 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.864187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45dfe3-e603-4869-847f-bde202879cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.864758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45dfe3-e603-4869-847f-bde202879cdd None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.865040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45dfe3-e603-4869-847f-bde202879cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.865317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45dfe3-e603-4869-847f-bde202879cdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.875921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45dfe3-e603-4869-847f-bde202879cdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.877367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45dfe3-e603-4869-847f-bde202879cdd None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.877765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b472d9-8c19-4baa-a63d-2ea1cadca751 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-0b45dfe3-e603-4869-847f-bde202879cdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:26.890405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:26.891477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:26.892524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:26.892524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:26.892524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:26.892524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:26.892524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:26.892524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:26.892524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:26.892524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:26.892524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 266/537] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:26.898600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45dfe3-e603-4869-847f-bde202879cdd None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.927649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fce2c-c489-4d24-992a-d56f5b4b84d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.928304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fce2c-c489-4d24-992a-d56f5b4b84d0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.928587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fce2c-c489-4d24-992a-d56f5b4b84d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.928861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fce2c-c489-4d24-992a-d56f5b4b84d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.929695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fce2c-c489-4d24-992a-d56f5b4b84d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.930031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fce2c-c489-4d24-992a-d56f5b4b84d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.931660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fce2c-c489-4d24-992a-d56f5b4b84d0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.937545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.952516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 272/538] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.958744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fce2c-c489-4d24-992a-d56f5b4b84d0 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:27.029512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45dfe3-e603-4869-847f-bde202879cdd None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.074663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baee805-8575-4a78-bba0-d029f14124bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:27.075518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee805-8575-4a78-bba0-d029f14124bb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.076021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee805-8575-4a78-bba0-d029f14124bb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.076437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee805-8575-4a78-bba0-d029f14124bb None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.077280 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee805-8575-4a78-bba0-d029f14124bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:27.077759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee805-8575-4a78-bba0-d029f14124bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:27.079552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee805-8575-4a78-bba0-d029f14124bb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:27.088346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fce2c-c489-4d24-992a-d56f5b4b84d0 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.098236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:27.100793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 267/539] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:27.102231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d54ac3-8afe-4a33-9876-618a53f86ac2 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.102669 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d54ac3-8afe-4a33-9876-618a53f86ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.103095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d54ac3-8afe-4a33-9876-618a53f86ac2 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.104736 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 268/540] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:27.106223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d54ac3-8afe-4a33-9876-618a53f86ac2 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:27.130624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671893c-6739-49eb-83a7-9cfbba662978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:27.131152 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671893c-6739-49eb-83a7-9cfbba662978 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.131432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671893c-6739-49eb-83a7-9cfbba662978 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.131756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671893c-6739-49eb-83a7-9cfbba662978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.132498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671893c-6739-49eb-83a7-9cfbba662978 None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=953c57f22b304dcda6fcaba3fb01d666) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:27.132847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671893c-6739-49eb-83a7-9cfbba662978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:27.134488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671893c-6739-49eb-83a7-9cfbba662978 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:27.145706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 273/541] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/role_assignments?user.id=953c57f22b304dcda6fcaba3fb01d666&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:27.145706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f628f-555f-4cc8-adcc-bff7244fcead None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.145706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f628f-555f-4cc8-adcc-bff7244fcead None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.145706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f628f-555f-4cc8-adcc-bff7244fcead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.169712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-686f628f-555f-4cc8-adcc-bff7244fcead None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:27.169712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-686f628f-555f-4cc8-adcc-bff7244fcead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:27.294093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:27.302317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d54ac3-8afe-4a33-9876-618a53f86ac2 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.311187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 274/542] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:27.359067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f2cb9-cc23-4267-8745-78125fdb1492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:27.359735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f2cb9-cc23-4267-8745-78125fdb1492 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.360015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f2cb9-cc23-4267-8745-78125fdb1492 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.360295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f2cb9-cc23-4267-8745-78125fdb1492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.361036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f2cb9-cc23-4267-8745-78125fdb1492 None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=f14e5614aee44c59a47b12e5b35ea3fa) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:27.361343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f2cb9-cc23-4267-8745-78125fdb1492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:27.364006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f2cb9-cc23-4267-8745-78125fdb1492 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:27.371493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 269/543] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:27 2022] GET /identity/v3/role_assignments?user.id=f14e5614aee44c59a47b12e5b35ea3fa&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:27.645363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f628f-555f-4cc8-adcc-bff7244fcead None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:27.710514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbb9fa-d470-481e-90f3-d7b1947b4a38 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.710836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbb9fa-d470-481e-90f3-d7b1947b4a38 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.711069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbb9fa-d470-481e-90f3-d7b1947b4a38 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.712678 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 270/544] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:27.718279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b61c9-1683-4f42-a989-af03e3cfb864 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.718556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b61c9-1683-4f42-a989-af03e3cfb864 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.718839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b61c9-1683-4f42-a989-af03e3cfb864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.750401 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-799b61c9-1683-4f42-a989-af03e3cfb864 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:27.751617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-799b61c9-1683-4f42-a989-af03e3cfb864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:27.782052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f628f-555f-4cc8-adcc-bff7244fcead None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:27.784156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:27.859896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62865a6-a160-4d32-9143-808d90fee16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:27.860663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62865a6-a160-4d32-9143-808d90fee16d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:27.860947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62865a6-a160-4d32-9143-808d90fee16d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:27.861226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62865a6-a160-4d32-9143-808d90fee16d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:27.874843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 271/545] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:08:27.882105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62865a6-a160-4d32-9143-808d90fee16d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-e62865a6-a160-4d32-9143-808d90fee16d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:27.891461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:27.892870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:27.893983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:27.897250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 275/546] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:27.902725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b61c9-1683-4f42-a989-af03e3cfb864 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.034206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.056197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b61c9-1683-4f42-a989-af03e3cfb864 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.111049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7683178-5806-4588-9c56-94d4a38be9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.111696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683178-5806-4588-9c56-94d4a38be9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.111982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683178-5806-4588-9c56-94d4a38be9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.112261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683178-5806-4588-9c56-94d4a38be9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.112954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7683178-5806-4588-9c56-94d4a38be9e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:28.113826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7683178-5806-4588-9c56-94d4a38be9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.115215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7683178-5806-4588-9c56-94d4a38be9e0 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.124568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 272/547] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:28.130729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62865a6-a160-4d32-9143-808d90fee16d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.166947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7683178-5806-4588-9c56-94d4a38be9e0 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.300267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7683178-5806-4588-9c56-94d4a38be9e0 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.357451 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f8fe-a8d9-401f-9211-68fdf272bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.358277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f8fe-a8d9-401f-9211-68fdf272bd41 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.358663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f8fe-a8d9-401f-9211-68fdf272bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.359054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f8fe-a8d9-401f-9211-68fdf272bd41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.377002 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55f8fe-a8d9-401f-9211-68fdf272bd41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-ce55f8fe-a8d9-401f-9211-68fdf272bd41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:28.382657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:28.384264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:28.386613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 273/548] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:28.395824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62865a6-a160-4d32-9143-808d90fee16d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.399447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f8fe-a8d9-401f-9211-68fdf272bd41 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.424300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.494711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfaa16-8d13-4f9f-9c4b-a4c3c8542434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.496131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfaa16-8d13-4f9f-9c4b-a4c3c8542434 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.498011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfaa16-8d13-4f9f-9c4b-a4c3c8542434 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.498783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfaa16-8d13-4f9f-9c4b-a4c3c8542434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.523428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfaa16-8d13-4f9f-9c4b-a4c3c8542434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.524378 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfaa16-8d13-4f9f-9c4b-a4c3c8542434 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-c9cfaa16-8d13-4f9f-9c4b-a4c3c8542434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:28.560421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:28.561433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:28.562316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:28.562316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:28.562316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:28.566781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 276/549] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:28.570179 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f8fe-a8d9-401f-9211-68fdf272bd41 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.570604 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfaa16-8d13-4f9f-9c4b-a4c3c8542434 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.611660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.626168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c90aa0-0605-4b23-9fc4-545fab8257ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.627145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90aa0-0605-4b23-9fc4-545fab8257ac None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.627610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90aa0-0605-4b23-9fc4-545fab8257ac None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.628113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90aa0-0605-4b23-9fc4-545fab8257ac None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.629061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c90aa0-0605-4b23-9fc4-545fab8257ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:28.629684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c90aa0-0605-4b23-9fc4-545fab8257ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.631659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c90aa0-0605-4b23-9fc4-545fab8257ac None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.656066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 274/550] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:28.666783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c90aa0-0605-4b23-9fc4-545fab8257ac None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.748478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfaa16-8d13-4f9f-9c4b-a4c3c8542434 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.789517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738e808-ea22-439f-be6f-4c9e53f304e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.790462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738e808-ea22-439f-be6f-4c9e53f304e8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.790923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738e808-ea22-439f-be6f-4c9e53f304e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.791397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738e808-ea22-439f-be6f-4c9e53f304e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.792247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738e808-ea22-439f-be6f-4c9e53f304e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:28.792734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738e808-ea22-439f-be6f-4c9e53f304e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:28.794346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738e808-ea22-439f-be6f-4c9e53f304e8 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:28.808244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 277/551] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:28.823229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738e808-ea22-439f-be6f-4c9e53f304e8 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:28.826240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.922128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:28.925067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c90aa0-0605-4b23-9fc4-545fab8257ac None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.952469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738e808-ea22-439f-be6f-4c9e53f304e8 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:28.994988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c07d8-8833-48b7-a056-16897c42c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:28.995632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c07d8-8833-48b7-a056-16897c42c315 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.995910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c07d8-8833-48b7-a056-16897c42c315 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.996198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c07d8-8833-48b7-a056-16897c42c315 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.006151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c07d8-8833-48b7-a056-16897c42c315 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.007524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c07d8-8833-48b7-a056-16897c42c315 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.009229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb207bca-8139-40d1-b5e6-038247929140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.010026 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb207bca-8139-40d1-b5e6-038247929140 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.010400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb207bca-8139-40d1-b5e6-038247929140 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.010691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb207bca-8139-40d1-b5e6-038247929140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-f40c07d8-8833-48b7-a056-16897c42c315 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:29.021042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:29.022214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:29.023180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 278/552] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:29.028085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c07d8-8833-48b7-a056-16897c42c315 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.038820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb207bca-8139-40d1-b5e6-038247929140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.040429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb207bca-8139-40d1-b5e6-038247929140 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-cb207bca-8139-40d1-b5e6-038247929140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:29.069079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:29.071335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:29.073156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:29.073156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:29.073156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:29.073156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 275/553] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:29.081726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb207bca-8139-40d1-b5e6-038247929140 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.135932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c07d8-8833-48b7-a056-16897c42c315 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.174863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b65ab-2416-4494-aded-782e56ba91bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.175953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b65ab-2416-4494-aded-782e56ba91bd None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.176417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b65ab-2416-4494-aded-782e56ba91bd None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.176872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b65ab-2416-4494-aded-782e56ba91bd None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.177938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b65ab-2416-4494-aded-782e56ba91bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:29.178425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b65ab-2416-4494-aded-782e56ba91bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.180168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b65ab-2416-4494-aded-782e56ba91bd None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.198056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.201770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 279/554] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:29.203301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340736-f441-413a-ad7c-2f97b51abea0 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.203802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340736-f441-413a-ad7c-2f97b51abea0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.204254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340736-f441-413a-ad7c-2f97b51abea0 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.209764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 280/555] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:29.213994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55340736-f441-413a-ad7c-2f97b51abea0 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.240911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb207bca-8139-40d1-b5e6-038247929140 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.273416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.296458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c2120-abae-4bae-a76d-dd9df1509715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.298012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2120-abae-4bae-a76d-dd9df1509715 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.299336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2120-abae-4bae-a76d-dd9df1509715 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.300014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2120-abae-4bae-a76d-dd9df1509715 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.302362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c2120-abae-4bae-a76d-dd9df1509715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:29.303861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c2120-abae-4bae-a76d-dd9df1509715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.306694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c2120-abae-4bae-a76d-dd9df1509715 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.331313 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 276/556] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:29.333094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451518e-b4a4-4e11-9edf-229702dec7a7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.333571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451518e-b4a4-4e11-9edf-229702dec7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.334056 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451518e-b4a4-4e11-9edf-229702dec7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.348707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55340736-f441-413a-ad7c-2f97b51abea0 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.353757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3451518e-b4a4-4e11-9edf-229702dec7a7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:29.355250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3451518e-b4a4-4e11-9edf-229702dec7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:29.388543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9713-28a7-4faf-9e23-d43c2d2fd2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.389494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9713-28a7-4faf-9e23-d43c2d2fd2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.390025 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9713-28a7-4faf-9e23-d43c2d2fd2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.390467 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9713-28a7-4faf-9e23-d43c2d2fd2d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.439937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 277/557] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:29.440834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451518e-b4a4-4e11-9edf-229702dec7a7 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.462121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.475638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9713-28a7-4faf-9e23-d43c2d2fd2d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.477712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9713-28a7-4faf-9e23-d43c2d2fd2d3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.592433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 281/558] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:29.601976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9713-28a7-4faf-9e23-d43c2d2fd2d3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.662011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451518e-b4a4-4e11-9edf-229702dec7a7 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.679296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.709244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180549-75f4-4ac2-8bf0-85e90fa6d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.709983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180549-75f4-4ac2-8bf0-85e90fa6d50a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.716720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180549-75f4-4ac2-8bf0-85e90fa6d50a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.716720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180549-75f4-4ac2-8bf0-85e90fa6d50a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.718083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180549-75f4-4ac2-8bf0-85e90fa6d50a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.719591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180549-75f4-4ac2-8bf0-85e90fa6d50a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-ad180549-75f4-4ac2-8bf0-85e90fa6d50a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:29.732008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:29.733234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:29.734536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 278/559] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:29.735203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1008491-f89a-4150-8bdb-51f86b9b9a2b None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.735203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1008491-f89a-4150-8bdb-51f86b9b9a2b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.735338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1008491-f89a-4150-8bdb-51f86b9b9a2b None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.736459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 279/560] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:29.741849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1008491-f89a-4150-8bdb-51f86b9b9a2b None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.751506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.764165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9713-28a7-4faf-9e23-d43c2d2fd2d3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.813822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb602e-5b21-4855-89d6-6841c54d291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.814849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb602e-5b21-4855-89d6-6841c54d291b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.815286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb602e-5b21-4855-89d6-6841c54d291b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.815719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb602e-5b21-4855-89d6-6841c54d291b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.832457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb602e-5b21-4855-89d6-6841c54d291b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.833314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb602e-5b21-4855-89d6-6841c54d291b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-9ccb602e-5b21-4855-89d6-6841c54d291b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:29.850102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:29.851171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:29.852050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:29.852050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:29.852050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:29.852050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 282/561] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:29.852386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db40ac-6e1d-4080-8c4a-9c4538c58440 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.852676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db40ac-6e1d-4080-8c4a-9c4538c58440 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.852946 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db40ac-6e1d-4080-8c4a-9c4538c58440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.863866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1008491-f89a-4150-8bdb-51f86b9b9a2b None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.871704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-61db40ac-6e1d-4080-8c4a-9c4538c58440 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:29.872918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-61db40ac-6e1d-4080-8c4a-9c4538c58440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:29.899127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92475b72-dabd-4666-adbc-ede72a90f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.899745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475b72-dabd-4666-adbc-ede72a90f42b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.900024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475b72-dabd-4666-adbc-ede72a90f42b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.900297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475b72-dabd-4666-adbc-ede72a90f42b None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.901049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475b72-dabd-4666-adbc-ede72a90f42b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:29.901354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475b72-dabd-4666-adbc-ede72a90f42b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.902811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475b72-dabd-4666-adbc-ede72a90f42b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.921578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 280/562] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:29.922597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92475b72-dabd-4666-adbc-ede72a90f42b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.941346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 283/563] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:29.942637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ef9ef-055b-40e1-b205-51a44d4b1fee None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.942927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ef9ef-055b-40e1-b205-51a44d4b1fee None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.943208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ef9ef-055b-40e1-b205-51a44d4b1fee None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.944476 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 284/564] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:29.945183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ef9ef-055b-40e1-b205-51a44d4b1fee None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.956032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.035942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.037061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92475b72-dabd-4666-adbc-ede72a90f42b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.064306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ef9ef-055b-40e1-b205-51a44d4b1fee None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.077164 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9556860-af83-411f-86fc-b212da206f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.077851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9556860-af83-411f-86fc-b212da206f00 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.078133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9556860-af83-411f-86fc-b212da206f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.078410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9556860-af83-411f-86fc-b212da206f00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.090153 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9556860-af83-411f-86fc-b212da206f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-c9556860-af83-411f-86fc-b212da206f00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:30.095094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:30.096135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 281/565] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:30.097158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9556860-af83-411f-86fc-b212da206f00 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.117524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7670ad-6d8a-4d50-80ad-d93580ea738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.118176 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7670ad-6d8a-4d50-80ad-d93580ea738c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.118528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7670ad-6d8a-4d50-80ad-d93580ea738c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.118867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7670ad-6d8a-4d50-80ad-d93580ea738c None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.119622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7670ad-6d8a-4d50-80ad-d93580ea738c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.120009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7670ad-6d8a-4d50-80ad-d93580ea738c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.121391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7670ad-6d8a-4d50-80ad-d93580ea738c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.134646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 285/566] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.135733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c2705-5f53-494d-943a-7017fa82f7f8 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.136022 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c2705-5f53-494d-943a-7017fa82f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.136301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c2705-5f53-494d-943a-7017fa82f7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.155047 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-695c2705-5f53-494d-943a-7017fa82f7f8 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:30.156248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-695c2705-5f53-494d-943a-7017fa82f7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:30.217532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.228176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9556860-af83-411f-86fc-b212da206f00 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.229807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 286/567] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:30.230670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c2705-5f53-494d-943a-7017fa82f7f8 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.265498 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd987c-1aa3-4d45-abb4-2a72c593e117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.266158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd987c-1aa3-4d45-abb4-2a72c593e117 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.266437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd987c-1aa3-4d45-abb4-2a72c593e117 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.266709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd987c-1aa3-4d45-abb4-2a72c593e117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.280533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd987c-1aa3-4d45-abb4-2a72c593e117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.282467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd987c-1aa3-4d45-abb4-2a72c593e117 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.307381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-cefd987c-1aa3-4d45-abb4-2a72c593e117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:30.309692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:30.311136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:30.312215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:30.312215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:30.312215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:30.315850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 282/568] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:30.316812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd987c-1aa3-4d45-abb4-2a72c593e117 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.351466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c2705-5f53-494d-943a-7017fa82f7f8 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.402957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41d34-65aa-4010-90a0-e728d4fa670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.402957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41d34-65aa-4010-90a0-e728d4fa670a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.402957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41d34-65aa-4010-90a0-e728d4fa670a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.402957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41d34-65aa-4010-90a0-e728d4fa670a None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.403457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb41d34-65aa-4010-90a0-e728d4fa670a None admin] RBAC: Adding query filter params (name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.403457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb41d34-65aa-4010-90a0-e728d4fa670a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.403993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb41d34-65aa-4010-90a0-e728d4fa670a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.417780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 287/569] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.417780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41d34-65aa-4010-90a0-e728d4fa670a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.429348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd987c-1aa3-4d45-abb4-2a72c593e117 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.466068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaccf1-deb5-4ab9-94f5-5f48800b54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.466788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaccf1-deb5-4ab9-94f5-5f48800b54e5 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.467138 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaccf1-deb5-4ab9-94f5-5f48800b54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.467482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaccf1-deb5-4ab9-94f5-5f48800b54e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.474947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eaccf1-deb5-4ab9-94f5-5f48800b54e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.476451 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eaccf1-deb5-4ab9-94f5-5f48800b54e5 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-f9eaccf1-deb5-4ab9-94f5-5f48800b54e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:30.488014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:30.489709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:30.490849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:30.490849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:30.490849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:30.490849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:30.490849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:30.490849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:30.490849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:30.490849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:30.494414 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 283/570] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:30.495268 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaccf1-deb5-4ab9-94f5-5f48800b54e5 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.498554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.525219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41d34-65aa-4010-90a0-e728d4fa670a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.557144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.567574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9567d03-9a79-4cf6-afba-7d3618d4c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.570935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9567d03-9a79-4cf6-afba-7d3618d4c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.570935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9567d03-9a79-4cf6-afba-7d3618d4c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.570935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9567d03-9a79-4cf6-afba-7d3618d4c5e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.579771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9567d03-9a79-4cf6-afba-7d3618d4c5e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-c9567d03-9a79-4cf6-afba-7d3618d4c5e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:30.584609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:30.585815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 288/571] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:30.586832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9567d03-9a79-4cf6-afba-7d3618d4c5e6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.605516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaccf1-deb5-4ab9-94f5-5f48800b54e5 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.643114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8b2a9-d587-4280-8834-a871bb6ee2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.643746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b2a9-d587-4280-8834-a871bb6ee2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.644025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b2a9-d587-4280-8834-a871bb6ee2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.644304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b2a9-d587-4280-8834-a871bb6ee2e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.644958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8b2a9-d587-4280-8834-a871bb6ee2e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.645263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8b2a9-d587-4280-8834-a871bb6ee2e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.646693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8b2a9-d587-4280-8834-a871bb6ee2e1 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.661209 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 284/572] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.662165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8b2a9-d587-4280-8834-a871bb6ee2e1 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.691475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9567d03-9a79-4cf6-afba-7d3618d4c5e6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.728059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92fe6-5883-4925-b48d-4d668694f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.728586 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.728704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92fe6-5883-4925-b48d-4d668694f0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.728965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92fe6-5883-4925-b48d-4d668694f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.729249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc92fe6-5883-4925-b48d-4d668694f0a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.741486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc92fe6-5883-4925-b48d-4d668694f0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.745518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc92fe6-5883-4925-b48d-4d668694f0a7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-5dc92fe6-5883-4925-b48d-4d668694f0a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:30.758203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:30.759413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:30.760276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:30.760276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:30.760276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:30.760276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 289/573] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:30.760613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92fe6-5883-4925-b48d-4d668694f0a7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.769759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8b2a9-d587-4280-8834-a871bb6ee2e1 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.802471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.805232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c638cb0-0e85-40bd-b790-ae49aff3ec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.805884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c638cb0-0e85-40bd-b790-ae49aff3ec54 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.806166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c638cb0-0e85-40bd-b790-ae49aff3ec54 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.806442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c638cb0-0e85-40bd-b790-ae49aff3ec54 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.807142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c638cb0-0e85-40bd-b790-ae49aff3ec54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.807452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c638cb0-0e85-40bd-b790-ae49aff3ec54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.808943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c638cb0-0e85-40bd-b790-ae49aff3ec54 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.824645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 285/574] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.825524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c638cb0-0e85-40bd-b790-ae49aff3ec54 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.872121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc92fe6-5883-4925-b48d-4d668694f0a7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.908597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a295dca-600f-4590-ab71-a97a66fe4ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.909223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a295dca-600f-4590-ab71-a97a66fe4ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.909514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a295dca-600f-4590-ab71-a97a66fe4ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.909820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a295dca-600f-4590-ab71-a97a66fe4ac0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.920776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a295dca-600f-4590-ab71-a97a66fe4ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-9a295dca-600f-4590-ab71-a97a66fe4ac0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:30.925609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:30.926871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 290/575] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:30.928147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a295dca-600f-4590-ab71-a97a66fe4ac0 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:30.935928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c638cb0-0e85-40bd-b790-ae49aff3ec54 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:30.960034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:30.971188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f2e05-ec9f-4e39-8303-6f1e69a4f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:30.985615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f2e05-ec9f-4e39-8303-6f1e69a4f598 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:30.985615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f2e05-ec9f-4e39-8303-6f1e69a4f598 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:30.985615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f2e05-ec9f-4e39-8303-6f1e69a4f598 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:30.985615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f2e05-ec9f-4e39-8303-6f1e69a4f598 None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:30.985615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f2e05-ec9f-4e39-8303-6f1e69a4f598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:30.985615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f2e05-ec9f-4e39-8303-6f1e69a4f598 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:30.986187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 286/576] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:30.986187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f2e05-ec9f-4e39-8303-6f1e69a4f598 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.044255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.047692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a295dca-600f-4590-ab71-a97a66fe4ac0 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.086741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6871b4-adee-4209-a007-e022e5f244b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.087595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6871b4-adee-4209-a007-e022e5f244b7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.087720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6871b4-adee-4209-a007-e022e5f244b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.087927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6871b4-adee-4209-a007-e022e5f244b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.092957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f2e05-ec9f-4e39-8303-6f1e69a4f598 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.095019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6871b4-adee-4209-a007-e022e5f244b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.096484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6871b4-adee-4209-a007-e022e5f244b7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-0e6871b4-adee-4209-a007-e022e5f244b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:31.108825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:31.109949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:31.111050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:31.111050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:31.111050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:31.111050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:31.111050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:31.111050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:31.111050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:31.111050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:31.111050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 291/577] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:31.111050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6871b4-adee-4209-a007-e022e5f244b7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.138177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe5829-976f-4baa-8815-5122d2c8b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.138797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe5829-976f-4baa-8815-5122d2c8b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.139075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe5829-976f-4baa-8815-5122d2c8b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.139353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe5829-976f-4baa-8815-5122d2c8b0d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.140011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe5829-976f-4baa-8815-5122d2c8b0d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:31.140319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe5829-976f-4baa-8815-5122d2c8b0d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.141772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe5829-976f-4baa-8815-5122d2c8b0d0 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.155529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 287/578] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:31.156200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe5829-976f-4baa-8815-5122d2c8b0d0 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.209433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.224037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6871b4-adee-4209-a007-e022e5f244b7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.265958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9dc82-02bc-4e49-849e-1a6fc4ab22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.266571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9dc82-02bc-4e49-849e-1a6fc4ab22ed None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.266844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9dc82-02bc-4e49-849e-1a6fc4ab22ed None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.267113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9dc82-02bc-4e49-849e-1a6fc4ab22ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.267841 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9dc82-02bc-4e49-849e-1a6fc4ab22ed None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=78c331b659da48549c4c91e659ff83ba) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:31.268144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9dc82-02bc-4e49-849e-1a6fc4ab22ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.270202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9dc82-02bc-4e49-849e-1a6fc4ab22ed None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.270492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe5829-976f-4baa-8815-5122d2c8b0d0 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.275940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 292/579] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/role_assignments?user.id=78c331b659da48549c4c91e659ff83ba&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:31.276730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9dc82-02bc-4e49-849e-1a6fc4ab22ed None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.304932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.325008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df04ba7-8180-4a42-bf11-2b75d744d76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.325633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df04ba7-8180-4a42-bf11-2b75d744d76d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.325954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df04ba7-8180-4a42-bf11-2b75d744d76d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.326246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df04ba7-8180-4a42-bf11-2b75d744d76d None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.326927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df04ba7-8180-4a42-bf11-2b75d744d76d None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:31.327235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df04ba7-8180-4a42-bf11-2b75d744d76d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.328663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df04ba7-8180-4a42-bf11-2b75d744d76d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.339225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 288/580] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:31.340125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df04ba7-8180-4a42-bf11-2b75d744d76d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.416012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9dc82-02bc-4e49-849e-1a6fc4ab22ed None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.466679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd261841-80d3-4471-bdf0-de360b76446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.467247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261841-80d3-4471-bdf0-de360b76446b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.467534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261841-80d3-4471-bdf0-de360b76446b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.467811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261841-80d3-4471-bdf0-de360b76446b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.480632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd261841-80d3-4471-bdf0-de360b76446b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.482268 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd261841-80d3-4471-bdf0-de360b76446b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.489917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df04ba7-8180-4a42-bf11-2b75d744d76d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-dd261841-80d3-4471-bdf0-de360b76446b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:31.499016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:31.500195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:31.501335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:31.501335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:31.501335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:31.502664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.507097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 293/581] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:31.508059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd261841-80d3-4471-bdf0-de360b76446b None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.541093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b717-4f8d-45d8-a202-4787cf039654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.542336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b717-4f8d-45d8-a202-4787cf039654 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.542628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b717-4f8d-45d8-a202-4787cf039654 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.542907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5b717-4f8d-45d8-a202-4787cf039654 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.543626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5b717-4f8d-45d8-a202-4787cf039654 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:31.543934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5b717-4f8d-45d8-a202-4787cf039654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.545445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5b717-4f8d-45d8-a202-4787cf039654 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.565719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 289/582] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:31.565719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b717-4f8d-45d8-a202-4787cf039654 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.631059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.660247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd261841-80d3-4471-bdf0-de360b76446b None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.695298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5b717-4f8d-45d8-a202-4787cf039654 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.704896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597a37e-6e04-4650-a9a7-4798f1afd24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.705702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a37e-6e04-4650-a9a7-4798f1afd24c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.706071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a37e-6e04-4650-a9a7-4798f1afd24c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.706452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a37e-6e04-4650-a9a7-4798f1afd24c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.715238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597a37e-6e04-4650-a9a7-4798f1afd24c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.716876 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597a37e-6e04-4650-a9a7-4798f1afd24c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-c597a37e-6e04-4650-a9a7-4798f1afd24c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:31.728584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:31.729796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:31.730932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:31.730932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:31.730932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:31.730932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:31.730932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:31.730932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:31.730932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:31.730932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:31.730932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:08:31.730932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:31.736786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 294/583] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:31.736786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597a37e-6e04-4650-a9a7-4798f1afd24c None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.742728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4e54f-5c11-4ffa-ad1e-17bb155b318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.743801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4e54f-5c11-4ffa-ad1e-17bb155b318a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.744142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4e54f-5c11-4ffa-ad1e-17bb155b318a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.744419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4e54f-5c11-4ffa-ad1e-17bb155b318a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.756966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4e54f-5c11-4ffa-ad1e-17bb155b318a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.758118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4e54f-5c11-4ffa-ad1e-17bb155b318a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-aea4e54f-5c11-4ffa-ad1e-17bb155b318a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:31.774862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:31.780820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:31.781967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:31.781967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:31.781967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:31.781967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 290/584] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:31.781967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4e54f-5c11-4ffa-ad1e-17bb155b318a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.802148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.851452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597a37e-6e04-4650-a9a7-4798f1afd24c None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.891448 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec1e0-9063-4947-bc8d-d05e921ec206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.892176 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec1e0-9063-4947-bc8d-d05e921ec206 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.892461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec1e0-9063-4947-bc8d-d05e921ec206 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.892738 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec1e0-9063-4947-bc8d-d05e921ec206 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.893507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ec1e0-9063-4947-bc8d-d05e921ec206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:31.893845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ec1e0-9063-4947-bc8d-d05e921ec206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.895283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ec1e0-9063-4947-bc8d-d05e921ec206 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:31.896035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4e54f-5c11-4ffa-ad1e-17bb155b318a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:31.896898 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:31.908518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 295/585] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:31.909368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec1e0-9063-4947-bc8d-d05e921ec206 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:31.937602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc7b9-ebf1-49a9-99a0-5bb7fcb7fe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:31.938623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc7b9-ebf1-49a9-99a0-5bb7fcb7fe91 None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:31.938877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc7b9-ebf1-49a9-99a0-5bb7fcb7fe91 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:31.939154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc7b9-ebf1-49a9-99a0-5bb7fcb7fe91 None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/799cbde43a3643a4beef892d23145112/roles/5d7b9f9df87e4195be39d4c61f682b55` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:31.954845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc7b9-ebf1-49a9-99a0-5bb7fcb7fe91 None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=799cbde43a3643a4beef892d23145112, role_id=5d7b9f9df87e4195be39d4c61f682b55)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:31.956284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc7b9-ebf1-49a9-99a0-5bb7fcb7fe91 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:32.015960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec1e0-9063-4947-bc8d-d05e921ec206 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.047492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 291/586] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:31 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/799cbde43a3643a4beef892d23145112/roles/5d7b9f9df87e4195be39d4c61f682b55 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:32.048985 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc7b9-ebf1-49a9-99a0-5bb7fcb7fe91 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.053094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898460a0-2ba6-4bbc-8ab6-2c2795a3443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.053740 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898460a0-2ba6-4bbc-8ab6-2c2795a3443a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.054023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898460a0-2ba6-4bbc-8ab6-2c2795a3443a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.054292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898460a0-2ba6-4bbc-8ab6-2c2795a3443a None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.055137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898460a0-2ba6-4bbc-8ab6-2c2795a3443a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:32.055469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898460a0-2ba6-4bbc-8ab6-2c2795a3443a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:32.056952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898460a0-2ba6-4bbc-8ab6-2c2795a3443a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:32.081462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 296/587] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 31 19:08:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:32.082434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898460a0-2ba6-4bbc-8ab6-2c2795a3443a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.149052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:32.152959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:32.205546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc7b9-ebf1-49a9-99a0-5bb7fcb7fe91 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.231250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898460a0-2ba6-4bbc-8ab6-2c2795a3443a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.260410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2bc71-ffa3-46ad-a6df-d53ced7bab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.261393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2bc71-ffa3-46ad-a6df-d53ced7bab7d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.261907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2bc71-ffa3-46ad-a6df-d53ced7bab7d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.262386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2bc71-ffa3-46ad-a6df-d53ced7bab7d None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.263244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2bc71-ffa3-46ad-a6df-d53ced7bab7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:32.263758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2bc71-ffa3-46ad-a6df-d53ced7bab7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:32.265436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2bc71-ffa3-46ad-a6df-d53ced7bab7d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:32.280673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 292/588] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:32.282558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2bc71-ffa3-46ad-a6df-d53ced7bab7d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.288381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a720cbb-20d1-46ea-88e3-d3634cbbe6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.289415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720cbb-20d1-46ea-88e3-d3634cbbe6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.289948 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720cbb-20d1-46ea-88e3-d3634cbbe6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.290454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720cbb-20d1-46ea-88e3-d3634cbbe6b8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.299132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a720cbb-20d1-46ea-88e3-d3634cbbe6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:32.301004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a720cbb-20d1-46ea-88e3-d3634cbbe6b8 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-9a720cbb-20d1-46ea-88e3-d3634cbbe6b8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:32.314570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:32.315592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:32.316551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:32.316551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:32.316551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:32.316551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:32.316551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:32.316551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:32.316551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:32.316551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:32.316551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:08:32.316551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:32.318918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 297/589] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:32.324656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a720cbb-20d1-46ea-88e3-d3634cbbe6b8 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.406287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2bc71-ffa3-46ad-a6df-d53ced7bab7d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.444937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:32.457266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9dbac-5e7a-4c90-969e-98ab31cc122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.458207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9dbac-5e7a-4c90-969e-98ab31cc122e None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.458496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9dbac-5e7a-4c90-969e-98ab31cc122e None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.458777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9dbac-5e7a-4c90-969e-98ab31cc122e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.460526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a720cbb-20d1-46ea-88e3-d3634cbbe6b8 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.472738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9dbac-5e7a-4c90-969e-98ab31cc122e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:32.474832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9dbac-5e7a-4c90-969e-98ab31cc122e None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:32.480437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-bba9dbac-5e7a-4c90-969e-98ab31cc122e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:32.495371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:32.496787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:32.498204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:32.498204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:32.498204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:32.501883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 293/590] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:32.504317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9dbac-5e7a-4c90-969e-98ab31cc122e None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.515242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaacbb-52db-4f2f-9301-96584ab82270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.516842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaacbb-52db-4f2f-9301-96584ab82270 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.517654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaacbb-52db-4f2f-9301-96584ab82270 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.518649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaacbb-52db-4f2f-9301-96584ab82270 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.532926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaacbb-52db-4f2f-9301-96584ab82270 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:32.534384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaacbb-52db-4f2f-9301-96584ab82270 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-89eaacbb-52db-4f2f-9301-96584ab82270 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:32.550332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:32.552125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:32.553057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:32.553057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:32.553057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:32.553057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:32.553057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:32.553057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:32.553057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:32.553057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:32.553057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:08:32.553057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:32.557291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 298/591] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:32.558254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaacbb-52db-4f2f-9301-96584ab82270 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.665595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9dbac-5e7a-4c90-969e-98ab31cc122e None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.707399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75c1be-01e0-407a-9d61-9f3c81feea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.708025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75c1be-01e0-407a-9d61-9f3c81feea0a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.708312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75c1be-01e0-407a-9d61-9f3c81feea0a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.708587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75c1be-01e0-407a-9d61-9f3c81feea0a None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.709061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaacbb-52db-4f2f-9301-96584ab82270 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.709759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75c1be-01e0-407a-9d61-9f3c81feea0a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:32.709759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75c1be-01e0-407a-9d61-9f3c81feea0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:32.711103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75c1be-01e0-407a-9d61-9f3c81feea0a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:32.740163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 294/592] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 31 19:08:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:32.740163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75c1be-01e0-407a-9d61-9f3c81feea0a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.780688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c986b45-837c-4aea-9bd2-9ac259943063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.781597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:32.783536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c986b45-837c-4aea-9bd2-9ac259943063 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.784232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c986b45-837c-4aea-9bd2-9ac259943063 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.785380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c986b45-837c-4aea-9bd2-9ac259943063 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.786699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c986b45-837c-4aea-9bd2-9ac259943063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:32.787444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c986b45-837c-4aea-9bd2-9ac259943063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:32.790474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c986b45-837c-4aea-9bd2-9ac259943063 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:32.812836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 299/593] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:32.814496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c986b45-837c-4aea-9bd2-9ac259943063 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.855774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:32.862105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75c1be-01e0-407a-9d61-9f3c81feea0a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.909546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6d51c-4b50-4767-ae48-12727404900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.910722 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6d51c-4b50-4767-ae48-12727404900d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.911004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6d51c-4b50-4767-ae48-12727404900d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.911274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6d51c-4b50-4767-ae48-12727404900d None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:32.912017 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6d51c-4b50-4767-ae48-12727404900d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:32.912325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6d51c-4b50-4767-ae48-12727404900d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:32.913776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6d51c-4b50-4767-ae48-12727404900d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:32.941454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 295/594] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 31 19:08:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:32.943431 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6d51c-4b50-4767-ae48-12727404900d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:32.949932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c986b45-837c-4aea-9bd2-9ac259943063 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:32.989396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97c79-8380-4977-bd47-19548b406dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:32.990046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97c79-8380-4977-bd47-19548b406dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:32.990325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97c79-8380-4977-bd47-19548b406dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:32.990598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa97c79-8380-4977-bd47-19548b406dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.002084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa97c79-8380-4977-bd47-19548b406dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.003609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa97c79-8380-4977-bd47-19548b406dc0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-9aa97c79-8380-4977-bd47-19548b406dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:33.020779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:33.025403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:33.026452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:33.026452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:33.026452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:33.026452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 300/595] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:33.026917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97c79-8380-4977-bd47-19548b406dc0 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.066780 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:33.073084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6d51c-4b50-4767-ae48-12727404900d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.124126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd3ae-f74c-4ed6-9a7b-5bbbbede775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.125310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd3ae-f74c-4ed6-9a7b-5bbbbede775a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.125601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd3ae-f74c-4ed6-9a7b-5bbbbede775a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.125918 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd3ae-f74c-4ed6-9a7b-5bbbbede775a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.136315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acd3ae-f74c-4ed6-9a7b-5bbbbede775a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.137946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acd3ae-f74c-4ed6-9a7b-5bbbbede775a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-b2acd3ae-f74c-4ed6-9a7b-5bbbbede775a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:33.155719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:33.156689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:33.157594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:33.157594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:33.157594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:33.157594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:33.157594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:33.157594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:33.157594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:33.157594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:33.161770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 296/596] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:33.163161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd3ae-f74c-4ed6-9a7b-5bbbbede775a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.193545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:33.218892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa97c79-8380-4977-bd47-19548b406dc0 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.258127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3cd41-b5ff-4fba-a691-4309d91d72e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.259305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3cd41-b5ff-4fba-a691-4309d91d72e7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.259305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3cd41-b5ff-4fba-a691-4309d91d72e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.259499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3cd41-b5ff-4fba-a691-4309d91d72e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.270395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3cd41-b5ff-4fba-a691-4309d91d72e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.271866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3cd41-b5ff-4fba-a691-4309d91d72e7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.288147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acd3ae-f74c-4ed6-9a7b-5bbbbede775a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b8d3cd41-b5ff-4fba-a691-4309d91d72e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:33.289394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:33.290595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:33.291564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:33.291564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:33.291564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:33.291564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 301/597] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:33.291564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3cd41-b5ff-4fba-a691-4309d91d72e7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.333685 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489f23f-bc26-47b4-b25b-b290840ba0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.334225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f23f-bc26-47b4-b25b-b290840ba0aa None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.334512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f23f-bc26-47b4-b25b-b290840ba0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.334791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489f23f-bc26-47b4-b25b-b290840ba0aa None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.335449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489f23f-bc26-47b4-b25b-b290840ba0aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:33.335759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489f23f-bc26-47b4-b25b-b290840ba0aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.337137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489f23f-bc26-47b4-b25b-b290840ba0aa None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.349797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 297/598] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:33.351054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60908d7-c558-428a-bcf1-92afbcc0f354 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.351351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60908d7-c558-428a-bcf1-92afbcc0f354 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.351628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60908d7-c558-428a-bcf1-92afbcc0f354 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.357147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 298/599] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:33.357147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60908d7-c558-428a-bcf1-92afbcc0f354 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.376516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:33.412336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3cd41-b5ff-4fba-a691-4309d91d72e7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.449011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744191f9-668c-4a91-8155-47f0051faaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.449618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744191f9-668c-4a91-8155-47f0051faaae None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.449927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744191f9-668c-4a91-8155-47f0051faaae None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.450204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744191f9-668c-4a91-8155-47f0051faaae None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.450915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744191f9-668c-4a91-8155-47f0051faaae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:33.451219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744191f9-668c-4a91-8155-47f0051faaae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.452672 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744191f9-668c-4a91-8155-47f0051faaae None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.456269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:33.473835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 302/600] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:33.473835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744191f9-668c-4a91-8155-47f0051faaae None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.489408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60908d7-c558-428a-bcf1-92afbcc0f354 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.540027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c456ba-f4dc-48bb-851e-2f7310d56f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.540955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c456ba-f4dc-48bb-851e-2f7310d56f9d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.541410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c456ba-f4dc-48bb-851e-2f7310d56f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.541910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c456ba-f4dc-48bb-851e-2f7310d56f9d None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.542926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c456ba-f4dc-48bb-851e-2f7310d56f9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:33.543433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c456ba-f4dc-48bb-851e-2f7310d56f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.545749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c456ba-f4dc-48bb-851e-2f7310d56f9d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.573960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 299/601] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:33.575433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec6b73-fdf1-49e2-8dd2-58768b6566cf None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.575903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec6b73-fdf1-49e2-8dd2-58768b6566cf None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.576352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec6b73-fdf1-49e2-8dd2-58768b6566cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.603634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-2dec6b73-fdf1-49e2-8dd2-58768b6566cf None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:33.605400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2dec6b73-fdf1-49e2-8dd2-58768b6566cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:33.629205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744191f9-668c-4a91-8155-47f0051faaae None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.679054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557ba84-25e2-47e1-8697-77b811d61513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.679882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557ba84-25e2-47e1-8697-77b811d61513 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.680238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557ba84-25e2-47e1-8697-77b811d61513 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.680584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557ba84-25e2-47e1-8697-77b811d61513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.689216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557ba84-25e2-47e1-8697-77b811d61513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.690730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557ba84-25e2-47e1-8697-77b811d61513 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.702255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 300/602] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:33.703381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec6b73-fdf1-49e2-8dd2-58768b6566cf None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-5557ba84-25e2-47e1-8697-77b811d61513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:33.704012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:33.704849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:33.705788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:33.705788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:33.705788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:33.705788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:33.705788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:33.705788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:33.705788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:33.705788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:33.710626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 303/603] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:33.711545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557ba84-25e2-47e1-8697-77b811d61513 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.716948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:33.788136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:33.831134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec6b73-fdf1-49e2-8dd2-58768b6566cf None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.843799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557ba84-25e2-47e1-8697-77b811d61513 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:33.871367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfc80b-cec1-4937-bb28-1c791ef6b325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.872864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc80b-cec1-4937-bb28-1c791ef6b325 None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.873425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc80b-cec1-4937-bb28-1c791ef6b325 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.873951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc80b-cec1-4937-bb28-1c791ef6b325 None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/b263d1092fc148129020ba73f2b8fbd3/roles/5d7b9f9df87e4195be39d4c61f682b55` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.880951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bc33d-e1dc-4af4-89ef-3593514e30c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:33.881593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bc33d-e1dc-4af4-89ef-3593514e30c0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:33.881905 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bc33d-e1dc-4af4-89ef-3593514e30c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:33.882183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bc33d-e1dc-4af4-89ef-3593514e30c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:33.889495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bc33d-e1dc-4af4-89ef-3593514e30c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.891005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bc33d-e1dc-4af4-89ef-3593514e30c0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.894699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfc80b-cec1-4937-bb28-1c791ef6b325 None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=b263d1092fc148129020ba73f2b8fbd3, role_id=5d7b9f9df87e4195be39d4c61f682b55)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:33.896719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfc80b-cec1-4937-bb28-1c791ef6b325 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-f90bc33d-e1dc-4af4-89ef-3593514e30c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:33.903699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:33.904820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:33.906081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:33.906081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:33.906081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:33.906081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:33.906081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:33.906081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:33.906081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:33.906081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:33.906081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 304/604] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:33.910488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bc33d-e1dc-4af4-89ef-3593514e30c0 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:33.985956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 301/605] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:33 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/b263d1092fc148129020ba73f2b8fbd3/roles/5d7b9f9df87e4195be39d4c61f682b55 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:33.988709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfc80b-cec1-4937-bb28-1c791ef6b325 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:34.051632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bc33d-e1dc-4af4-89ef-3593514e30c0 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:34.072491 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:34.076347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:34.098039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f34ff-8273-457f-a74c-a17178c26359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:34.099085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f34ff-8273-457f-a74c-a17178c26359 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.099429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f34ff-8273-457f-a74c-a17178c26359 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.099781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f34ff-8273-457f-a74c-a17178c26359 None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.100577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f34ff-8273-457f-a74c-a17178c26359 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:34.100963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f34ff-8273-457f-a74c-a17178c26359 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:34.102606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f34ff-8273-457f-a74c-a17178c26359 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:34.125422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 305/606] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:34.127383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f34ff-8273-457f-a74c-a17178c26359 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:34.135950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfc80b-cec1-4937-bb28-1c791ef6b325 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:34.186998 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811b4e5-d43b-4718-ba54-ad93c1574ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:34.187784 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811b4e5-d43b-4718-ba54-ad93c1574ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.188194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811b4e5-d43b-4718-ba54-ad93c1574ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.188557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811b4e5-d43b-4718-ba54-ad93c1574ca0 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.189484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811b4e5-d43b-4718-ba54-ad93c1574ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:34.189920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811b4e5-d43b-4718-ba54-ad93c1574ca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:34.192102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811b4e5-d43b-4718-ba54-ad93c1574ca0 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:34.205094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 302/607] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:34.205652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811b4e5-d43b-4718-ba54-ad93c1574ca0 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:34.255275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f34ff-8273-457f-a74c-a17178c26359 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:34.292728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adead875-d1a5-4284-abae-5e084607ca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:34.293563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adead875-d1a5-4284-abae-5e084607ca91 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.293726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adead875-d1a5-4284-abae-5e084607ca91 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.293920 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adead875-d1a5-4284-abae-5e084607ca91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.305790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adead875-d1a5-4284-abae-5e084607ca91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-adead875-d1a5-4284-abae-5e084607ca91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:34.310589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:34.311550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:34.312466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 306/608] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:34.313133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e6309-b129-4258-9f69-5206d082c607 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.313133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e6309-b129-4258-9f69-5206d082c607 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.314132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e6309-b129-4258-9f69-5206d082c607 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.314849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 307/609] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:34.315345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e6309-b129-4258-9f69-5206d082c607 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:34.323388 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811b4e5-d43b-4718-ba54-ad93c1574ca0 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:34.341933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:34.357225 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:34.359876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a41d7-af1c-412d-b8be-6f93c5ffa1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:34.360551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a41d7-af1c-412d-b8be-6f93c5ffa1e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.360907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a41d7-af1c-412d-b8be-6f93c5ffa1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.361147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a41d7-af1c-412d-b8be-6f93c5ffa1e5 None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/953c57f22b304dcda6fcaba3fb01d666/roles/5d7b9f9df87e4195be39d4c61f682b55` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.377513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a41d7-af1c-412d-b8be-6f93c5ffa1e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=953c57f22b304dcda6fcaba3fb01d666, role_id=5d7b9f9df87e4195be39d4c61f682b55)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:34.379333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a41d7-af1c-412d-b8be-6f93c5ffa1e5 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:34.425040 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e6309-b129-4258-9f69-5206d082c607 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:34.460240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 303/610] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:34 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/953c57f22b304dcda6fcaba3fb01d666/roles/5d7b9f9df87e4195be39d4c61f682b55 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:34.460582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e34443-86a2-43f9-98d6-38df13ef941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:34.461255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e34443-86a2-43f9-98d6-38df13ef941b None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.461583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e34443-86a2-43f9-98d6-38df13ef941b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.461890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e34443-86a2-43f9-98d6-38df13ef941b None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/f14e5614aee44c59a47b12e5b35ea3fa/roles/5d7b9f9df87e4195be39d4c61f682b55` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.462048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a41d7-af1c-412d-b8be-6f93c5ffa1e5 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:34.485601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e34443-86a2-43f9-98d6-38df13ef941b None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=f14e5614aee44c59a47b12e5b35ea3fa, role_id=5d7b9f9df87e4195be39d4c61f682b55)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:34.487123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e34443-86a2-43f9-98d6-38df13ef941b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:34.566110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 308/611] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:34 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/f14e5614aee44c59a47b12e5b35ea3fa/roles/5d7b9f9df87e4195be39d4c61f682b55 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:34.567809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acb957-1325-4dad-bb51-2c1654524dd3 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.568097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acb957-1325-4dad-bb51-2c1654524dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.568375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acb957-1325-4dad-bb51-2c1654524dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.613606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c2acb957-1325-4dad-bb51-2c1654524dd3 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:34.615901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c2acb957-1325-4dad-bb51-2c1654524dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:34.631477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a41d7-af1c-412d-b8be-6f93c5ffa1e5 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:34.688202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c392016-0c2e-45b5-b27b-331029efe3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:34.689360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392016-0c2e-45b5-b27b-331029efe3ca None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.689803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392016-0c2e-45b5-b27b-331029efe3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.690114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392016-0c2e-45b5-b27b-331029efe3ca None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.691245 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c392016-0c2e-45b5-b27b-331029efe3ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:34.691715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c392016-0c2e-45b5-b27b-331029efe3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:34.694887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c392016-0c2e-45b5-b27b-331029efe3ca None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:34.706649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 304/612] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:34.714141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c392016-0c2e-45b5-b27b-331029efe3ca None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:34.752079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 309/613] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:34.786102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:34.849506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c392016-0c2e-45b5-b27b-331029efe3ca None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:34.891653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be7a1f-780b-4e6d-a0c9-8ad7654865ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:34.892397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be7a1f-780b-4e6d-a0c9-8ad7654865ed None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:34.892817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be7a1f-780b-4e6d-a0c9-8ad7654865ed None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:34.893187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be7a1f-780b-4e6d-a0c9-8ad7654865ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:34.911082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be7a1f-780b-4e6d-a0c9-8ad7654865ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:34.912710 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be7a1f-780b-4e6d-a0c9-8ad7654865ed None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-35be7a1f-780b-4e6d-a0c9-8ad7654865ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:34.931320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:34.932534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:34.933613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:34.933613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:34.933613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:34.934683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 305/614] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:34.940551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acb957-1325-4dad-bb51-2c1654524dd3 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:34.964810 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:35.082752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acb957-1325-4dad-bb51-2c1654524dd3 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.089929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be7a1f-780b-4e6d-a0c9-8ad7654865ed None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.132088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a01066-dfc7-4875-9471-69790cdda121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.133126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a01066-dfc7-4875-9471-69790cdda121 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.133625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a01066-dfc7-4875-9471-69790cdda121 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.134144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a01066-dfc7-4875-9471-69790cdda121 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.135314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a01066-dfc7-4875-9471-69790cdda121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:35.135850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a01066-dfc7-4875-9471-69790cdda121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:35.142906 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a01066-dfc7-4875-9471-69790cdda121 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:35.179322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 310/615] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:35.185042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a01066-dfc7-4875-9471-69790cdda121 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.284466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:35.308006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be7a1f-780b-4e6d-a0c9-8ad7654865ed None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.353303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff8266-a5e6-4956-b0e1-a1ffa094bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.354332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8266-a5e6-4956-b0e1-a1ffa094bef8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.354820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8266-a5e6-4956-b0e1-a1ffa094bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.355431 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff8266-a5e6-4956-b0e1-a1ffa094bef8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.360753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:35.380654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff8266-a5e6-4956-b0e1-a1ffa094bef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-fdff8266-a5e6-4956-b0e1-a1ffa094bef8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:35.390400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:35.391358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:35.392167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:35.392786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 306/616] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:35.398759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a01066-dfc7-4875-9471-69790cdda121 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.401002 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff8266-a5e6-4956-b0e1-a1ffa094bef8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.466045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b05c4-0c6b-458c-ac0f-4f6f6afa7b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.466702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b05c4-0c6b-458c-ac0f-4f6f6afa7b6b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.466979 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b05c4-0c6b-458c-ac0f-4f6f6afa7b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.467249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b05c4-0c6b-458c-ac0f-4f6f6afa7b6b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.483910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b05c4-0c6b-458c-ac0f-4f6f6afa7b6b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:35.485361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b05c4-0c6b-458c-ac0f-4f6f6afa7b6b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-cf3b05c4-0c6b-458c-ac0f-4f6f6afa7b6b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:35.507858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:35.508847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:35.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:35.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:35.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:35.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:35.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:35.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:35.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:35.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:35.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:35.509763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:35.510448 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 311/617] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:35.516211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b05c4-0c6b-458c-ac0f-4f6f6afa7b6b None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.591943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff8266-a5e6-4956-b0e1-a1ffa094bef8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.638408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dea0d-3b3a-4eed-969a-79fda11da7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.639878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dea0d-3b3a-4eed-969a-79fda11da7bb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.640167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dea0d-3b3a-4eed-969a-79fda11da7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.640442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dea0d-3b3a-4eed-969a-79fda11da7bb None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.641135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dea0d-3b3a-4eed-969a-79fda11da7bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:35.641440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dea0d-3b3a-4eed-969a-79fda11da7bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:35.642870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dea0d-3b3a-4eed-969a-79fda11da7bb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:35.668736 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 307/618] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:35.673362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dea0d-3b3a-4eed-969a-79fda11da7bb None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.680547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:35.745167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b05c4-0c6b-458c-ac0f-4f6f6afa7b6b None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.852832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e8aff-5ad2-42ee-ad72-649239130bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:35.861702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e8aff-5ad2-42ee-ad72-649239130bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:35.861702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e8aff-5ad2-42ee-ad72-649239130bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:35.861702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e8aff-5ad2-42ee-ad72-649239130bc3 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:35.861702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e8aff-5ad2-42ee-ad72-649239130bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:35.862067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e8aff-5ad2-42ee-ad72-649239130bc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:35.868285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e8aff-5ad2-42ee-ad72-649239130bc3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:35.882236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:35.913696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 312/619] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:35.918820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e8aff-5ad2-42ee-ad72-649239130bc3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:35.928075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dea0d-3b3a-4eed-969a-79fda11da7bb None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:35.999426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e72712-7dc3-4499-9b73-991dfcda0f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.000076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72712-7dc3-4499-9b73-991dfcda0f69 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.000357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72712-7dc3-4499-9b73-991dfcda0f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.000629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72712-7dc3-4499-9b73-991dfcda0f69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.027570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e72712-7dc3-4499-9b73-991dfcda0f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.029397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e72712-7dc3-4499-9b73-991dfcda0f69 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-a5e72712-7dc3-4499-9b73-991dfcda0f69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:36.048811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:36.049876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:36.050808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:36.050808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:36.050808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:36.050984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 308/620] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:36.057955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e72712-7dc3-4499-9b73-991dfcda0f69 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.118985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e8aff-5ad2-42ee-ad72-649239130bc3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.161218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.178751 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beddb04-2e65-4121-bc01-2386ce5e568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.180047 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beddb04-2e65-4121-bc01-2386ce5e568b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.180534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beddb04-2e65-4121-bc01-2386ce5e568b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.181185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beddb04-2e65-4121-bc01-2386ce5e568b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.195076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beddb04-2e65-4121-bc01-2386ce5e568b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.197996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beddb04-2e65-4121-bc01-2386ce5e568b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.219550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e72712-7dc3-4499-9b73-991dfcda0f69 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-9beddb04-2e65-4121-bc01-2386ce5e568b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:36.220193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:36.221091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:36.221993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:36.221993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:36.221993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:36.223600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 313/621] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:36.229156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9fab4-9131-40dc-8016-601c56bef013 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.229156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9fab4-9131-40dc-8016-601c56bef013 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.229156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9fab4-9131-40dc-8016-601c56bef013 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.229156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 314/622] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:36.230883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9fab4-9131-40dc-8016-601c56bef013 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.267265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a3ac9-2146-4dcf-911a-a5c5f6a14ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.267748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3ac9-2146-4dcf-911a-a5c5f6a14ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.268075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3ac9-2146-4dcf-911a-a5c5f6a14ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.268358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3ac9-2146-4dcf-911a-a5c5f6a14ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.269036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a3ac9-2146-4dcf-911a-a5c5f6a14ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:36.269946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a3ac9-2146-4dcf-911a-a5c5f6a14ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.271531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a3ac9-2146-4dcf-911a-a5c5f6a14ae9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.287475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 309/623] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:36.288953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb633d-eadd-4106-85a0-28ff14a4d627 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.289233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb633d-eadd-4106-85a0-28ff14a4d627 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.289507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb633d-eadd-4106-85a0-28ff14a4d627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.307162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.310845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-67cb633d-eadd-4106-85a0-28ff14a4d627 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:36.312111 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-67cb633d-eadd-4106-85a0-28ff14a4d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:36.377304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9fab4-9131-40dc-8016-601c56bef013 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.403191 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 310/624] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:36.404447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb633d-eadd-4106-85a0-28ff14a4d627 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.437294 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c315d8-45a8-405e-abd0-99f806f5e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.437892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c315d8-45a8-405e-abd0-99f806f5e981 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.438172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c315d8-45a8-405e-abd0-99f806f5e981 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.438442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c315d8-45a8-405e-abd0-99f806f5e981 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.439094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c315d8-45a8-405e-abd0-99f806f5e981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:36.439423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c315d8-45a8-405e-abd0-99f806f5e981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.441519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c315d8-45a8-405e-abd0-99f806f5e981 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.467000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.468946 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 315/625] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:36.476050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c315d8-45a8-405e-abd0-99f806f5e981 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.541684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb633d-eadd-4106-85a0-28ff14a4d627 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.584883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d8e4-4527-48a4-ab75-a7f082d9aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.586240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d8e4-4527-48a4-ab75-a7f082d9aab5 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.587097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d8e4-4527-48a4-ab75-a7f082d9aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.587592 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d8e4-4527-48a4-ab75-a7f082d9aab5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.597542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928d8e4-4527-48a4-ab75-a7f082d9aab5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.600096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928d8e4-4527-48a4-ab75-a7f082d9aab5 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-0928d8e4-4527-48a4-ab75-a7f082d9aab5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:36.616246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:36.617254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:36.618236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:36.618236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:36.618236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:36.618236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:36.618236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:36.618236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:36.618236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:36.618236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:36.618236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:36.618236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:36.620772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 311/626] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:36.625859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d8e4-4527-48a4-ab75-a7f082d9aab5 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.695872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c315d8-45a8-405e-abd0-99f806f5e981 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.712739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.739502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d8e4-4527-48a4-ab75-a7f082d9aab5 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.747978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:36.770989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8739376-1e5b-4ea5-bd93-96e19ad1bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.771642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8739376-1e5b-4ea5-bd93-96e19ad1bc64 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.771926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8739376-1e5b-4ea5-bd93-96e19ad1bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.772229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8739376-1e5b-4ea5-bd93-96e19ad1bc64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.778143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df08d5-bb25-4778-9af5-9d95c83d19c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.778917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df08d5-bb25-4778-9af5-9d95c83d19c0 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.779300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df08d5-bb25-4778-9af5-9d95c83d19c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.779673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df08d5-bb25-4778-9af5-9d95c83d19c0 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.780161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8739376-1e5b-4ea5-bd93-96e19ad1bc64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.780591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df08d5-bb25-4778-9af5-9d95c83d19c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:36.780959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df08d5-bb25-4778-9af5-9d95c83d19c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:36.781625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8739376-1e5b-4ea5-bd93-96e19ad1bc64 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.792019 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df08d5-bb25-4778-9af5-9d95c83d19c0 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:36.802461 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 312/627] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b8739376-1e5b-4ea5-bd93-96e19ad1bc64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:36.802685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:36.803670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:36.804862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:36.804862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:36.804862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:36.804862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:36.804862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:36.804862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:36.804862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:36.804862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:36.805390 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df08d5-bb25-4778-9af5-9d95c83d19c0 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.805472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 316/628] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:36.814693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8739376-1e5b-4ea5-bd93-96e19ad1bc64 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:36.917081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df08d5-bb25-4778-9af5-9d95c83d19c0 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.928640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8739376-1e5b-4ea5-bd93-96e19ad1bc64 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:36.954951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485baa07-f091-4c5a-8d65-f12088910cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.955529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485baa07-f091-4c5a-8d65-f12088910cae None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.955808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485baa07-f091-4c5a-8d65-f12088910cae None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.956095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485baa07-f091-4c5a-8d65-f12088910cae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.972527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95241b2e-4652-4e81-a230-4f2a98fc3001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:36.973143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95241b2e-4652-4e81-a230-4f2a98fc3001 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:36.973421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95241b2e-4652-4e81-a230-4f2a98fc3001 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:36.973726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95241b2e-4652-4e81-a230-4f2a98fc3001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:36.974769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485baa07-f091-4c5a-8d65-f12088910cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-485baa07-f091-4c5a-8d65-f12088910cae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:36.980706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:36.989540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 313/629] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:36.990588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485baa07-f091-4c5a-8d65-f12088910cae None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.013758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.022227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.057364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95241b2e-4652-4e81-a230-4f2a98fc3001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.058875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95241b2e-4652-4e81-a230-4f2a98fc3001 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.096054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485baa07-f091-4c5a-8d65-f12088910cae None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.133460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad1a12-3804-4d5d-a238-9fa51d7fe483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.134403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad1a12-3804-4d5d-a238-9fa51d7fe483 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.134839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad1a12-3804-4d5d-a238-9fa51d7fe483 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.135289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad1a12-3804-4d5d-a238-9fa51d7fe483 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.135993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad1a12-3804-4d5d-a238-9fa51d7fe483 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:37.136304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad1a12-3804-4d5d-a238-9fa51d7fe483 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.137778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad1a12-3804-4d5d-a238-9fa51d7fe483 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.149985 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 314/630] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:37.151211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0f0ea-4a21-4b59-8f64-89551392bd20 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.151508 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0f0ea-4a21-4b59-8f64-89551392bd20 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.151796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0f0ea-4a21-4b59-8f64-89551392bd20 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.152991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 315/631] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:37.154740 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0f0ea-4a21-4b59-8f64-89551392bd20 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.171950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 317/632] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:37.173331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997801a3-7f69-4688-9cbf-2b45d8d46813 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.173573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997801a3-7f69-4688-9cbf-2b45d8d46813 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.173880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997801a3-7f69-4688-9cbf-2b45d8d46813 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.180009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 318/633] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:37.180009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997801a3-7f69-4688-9cbf-2b45d8d46813 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.246767 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.252204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.270535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0f0ea-4a21-4b59-8f64-89551392bd20 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.280801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997801a3-7f69-4688-9cbf-2b45d8d46813 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.305370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab84d-b050-4134-81aa-d1a5a7532d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.306448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab84d-b050-4134-81aa-d1a5a7532d8c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.306734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab84d-b050-4134-81aa-d1a5a7532d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.307003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab84d-b050-4134-81aa-d1a5a7532d8c None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.307663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab84d-b050-4134-81aa-d1a5a7532d8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:37.308080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab84d-b050-4134-81aa-d1a5a7532d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.309306 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab84d-b050-4134-81aa-d1a5a7532d8c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.317165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03370b66-be59-473e-a436-d0cb4bccc11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.317316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 316/634] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:37.317881 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370b66-be59-473e-a436-d0cb4bccc11c None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.318164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370b66-be59-473e-a436-d0cb4bccc11c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.318395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa552447-3b06-4b60-a3d2-f846f62558a9 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.318500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370b66-be59-473e-a436-d0cb4bccc11c None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/78c331b659da48549c4c91e659ff83ba/roles/5d7b9f9df87e4195be39d4c61f682b55` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.318679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa552447-3b06-4b60-a3d2-f846f62558a9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.318957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa552447-3b06-4b60-a3d2-f846f62558a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.333870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03370b66-be59-473e-a436-d0cb4bccc11c None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=78c331b659da48549c4c91e659ff83ba, role_id=5d7b9f9df87e4195be39d4c61f682b55)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.335300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03370b66-be59-473e-a436-d0cb4bccc11c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.336325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-aa552447-3b06-4b60-a3d2-f846f62558a9 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:37.337502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-aa552447-3b06-4b60-a3d2-f846f62558a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:37.402095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 317/635] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:37.402927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa552447-3b06-4b60-a3d2-f846f62558a9 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.445967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 319/636] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:37 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/78c331b659da48549c4c91e659ff83ba/roles/5d7b9f9df87e4195be39d4c61f682b55 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:37.447537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f62db-6af0-4a9a-8f99-ebed002f3b9f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.447828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f62db-6af0-4a9a-8f99-ebed002f3b9f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.448099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f62db-6af0-4a9a-8f99-ebed002f3b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.486034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.495671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4f1f62db-6af0-4a9a-8f99-ebed002f3b9f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:37.503408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4f1f62db-6af0-4a9a-8f99-ebed002f3b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:37.526223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa552447-3b06-4b60-a3d2-f846f62558a9 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.570847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdc25f-bfe2-4f16-9d26-d8f0dbf3be34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.571977 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdc25f-bfe2-4f16-9d26-d8f0dbf3be34 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.572459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdc25f-bfe2-4f16-9d26-d8f0dbf3be34 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.572932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdc25f-bfe2-4f16-9d26-d8f0dbf3be34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.586203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdc25f-bfe2-4f16-9d26-d8f0dbf3be34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.589565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdc25f-bfe2-4f16-9d26-d8f0dbf3be34 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.595060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 320/637] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:37.595060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f62db-6af0-4a9a-8f99-ebed002f3b9f None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-d8cdc25f-bfe2-4f16-9d26-d8f0dbf3be34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:37.616233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:37.617251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:37.618129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:37.618129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:37.618129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:37.622555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 318/638] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:37.623708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdc25f-bfe2-4f16-9d26-d8f0dbf3be34 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.657381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.719563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f62db-6af0-4a9a-8f99-ebed002f3b9f None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.735795 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdc25f-bfe2-4f16-9d26-d8f0dbf3be34 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.755632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a20d8f-7d06-4eea-a2b6-c90f763a8154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.756186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20d8f-7d06-4eea-a2b6-c90f763a8154 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.756462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20d8f-7d06-4eea-a2b6-c90f763a8154 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.756733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20d8f-7d06-4eea-a2b6-c90f763a8154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.766061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.767135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a20d8f-7d06-4eea-a2b6-c90f763a8154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.768599 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a20d8f-7d06-4eea-a2b6-c90f763a8154 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.773946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcacd59-54bf-41e5-b760-88c4ab692e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.774601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcacd59-54bf-41e5-b760-88c4ab692e97 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.774952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcacd59-54bf-41e5-b760-88c4ab692e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.784657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcacd59-54bf-41e5-b760-88c4ab692e97 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.784657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcacd59-54bf-41e5-b760-88c4ab692e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:37.784657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcacd59-54bf-41e5-b760-88c4ab692e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.784657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcacd59-54bf-41e5-b760-88c4ab692e97 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-f6a20d8f-7d06-4eea-a2b6-c90f763a8154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:37.786390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:37.787287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:37.788227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:37.788227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:37.788227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:37.788227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 321/639] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:37.788836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a20d8f-7d06-4eea-a2b6-c90f763a8154 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.792606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 319/640] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:37.798938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcacd59-54bf-41e5-b760-88c4ab692e97 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.910919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:37.914411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a20d8f-7d06-4eea-a2b6-c90f763a8154 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.942135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcacd59-54bf-41e5-b760-88c4ab692e97 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:37.950263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bd343-38af-448a-b16f-7fb402165043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.951231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bd343-38af-448a-b16f-7fb402165043 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.951342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bd343-38af-448a-b16f-7fb402165043 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.951553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bd343-38af-448a-b16f-7fb402165043 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.963746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bd343-38af-448a-b16f-7fb402165043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-369bd343-38af-448a-b16f-7fb402165043 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:37.969007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:37.970154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:37.970970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 322/641] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:37.971651 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bd343-38af-448a-b16f-7fb402165043 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:37.985333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9609-8230-4cb2-b69f-4c5cca0842cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:37.986043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9609-8230-4cb2-b69f-4c5cca0842cf None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:37.986335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9609-8230-4cb2-b69f-4c5cca0842cf None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:37.986614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d9609-8230-4cb2-b69f-4c5cca0842cf None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:37.987377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d9609-8230-4cb2-b69f-4c5cca0842cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:37.987687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d9609-8230-4cb2-b69f-4c5cca0842cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:37.989222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d9609-8230-4cb2-b69f-4c5cca0842cf None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.007328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 320/642] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:38.008161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9609-8230-4cb2-b69f-4c5cca0842cf None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.057990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:38.075194 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bd343-38af-448a-b16f-7fb402165043 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.110520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541977c9-73fa-4b1a-9f4c-95c7589cfbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.111142 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541977c9-73fa-4b1a-9f4c-95c7589cfbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.111424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541977c9-73fa-4b1a-9f4c-95c7589cfbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.111700 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541977c9-73fa-4b1a-9f4c-95c7589cfbf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.116499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d9609-8230-4cb2-b69f-4c5cca0842cf None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.119371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541977c9-73fa-4b1a-9f4c-95c7589cfbf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.120834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541977c9-73fa-4b1a-9f4c-95c7589cfbf3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-541977c9-73fa-4b1a-9f4c-95c7589cfbf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:38.133124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:38.134244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:38.135150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:38.135150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:38.135150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:38.135150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:38.135150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:38.135150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:38.135150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:38.135150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:38.135150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 323/643] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:38.135150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541977c9-73fa-4b1a-9f4c-95c7589cfbf3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.157577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:38.169180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0238b-f3f7-43d5-adb3-b656d65599fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.170097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0238b-f3f7-43d5-adb3-b656d65599fa None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.170545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0238b-f3f7-43d5-adb3-b656d65599fa None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.170825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0238b-f3f7-43d5-adb3-b656d65599fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.182603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0238b-f3f7-43d5-adb3-b656d65599fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-23e0238b-f3f7-43d5-adb3-b656d65599fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:38.187950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:38.188901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 321/644] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:38.189924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0238b-f3f7-43d5-adb3-b656d65599fa None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.260239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541977c9-73fa-4b1a-9f4c-95c7589cfbf3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.307942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f401e-6d44-4d81-a8b6-048c42d6bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.308564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f401e-6d44-4d81-a8b6-048c42d6bee6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.308843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f401e-6d44-4d81-a8b6-048c42d6bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.309208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f401e-6d44-4d81-a8b6-048c42d6bee6 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.309927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f401e-6d44-4d81-a8b6-048c42d6bee6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:38.310245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f401e-6d44-4d81-a8b6-048c42d6bee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.311641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f401e-6d44-4d81-a8b6-048c42d6bee6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.321826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 324/645] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:38.322601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f401e-6d44-4d81-a8b6-048c42d6bee6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.337927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0238b-f3f7-43d5-adb3-b656d65599fa None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.345958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:38.375875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95899310-db15-4ab0-8687-492445fd24ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.376691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95899310-db15-4ab0-8687-492445fd24ab None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.377001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95899310-db15-4ab0-8687-492445fd24ab None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.377470 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95899310-db15-4ab0-8687-492445fd24ab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.389134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95899310-db15-4ab0-8687-492445fd24ab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.391172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95899310-db15-4ab0-8687-492445fd24ab None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-95899310-db15-4ab0-8687-492445fd24ab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:38.406373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:38.407360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:38.408295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:38.408295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:38.408295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:38.408295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:38.408295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:38.408295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:38.408295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:38.408295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:38.408295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:08:38.408295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:38.412393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 322/646] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:38.413325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95899310-db15-4ab0-8687-492445fd24ab None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.423156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:38.446154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f401e-6d44-4d81-a8b6-048c42d6bee6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.484271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaddc0-b137-4afa-9c4c-32957b687ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.484880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaddc0-b137-4afa-9c4c-32957b687ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.485160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaddc0-b137-4afa-9c4c-32957b687ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.485434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaddc0-b137-4afa-9c4c-32957b687ee4 None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.486162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaddc0-b137-4afa-9c4c-32957b687ee4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:38.486466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaddc0-b137-4afa-9c4c-32957b687ee4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.488434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaddc0-b137-4afa-9c4c-32957b687ee4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.501794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 325/647] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:38.502643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaddc0-b137-4afa-9c4c-32957b687ee4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.538086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95899310-db15-4ab0-8687-492445fd24ab None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.581123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267be2e-f221-44b4-9c6a-23881efe78a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.581802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267be2e-f221-44b4-9c6a-23881efe78a4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.582082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267be2e-f221-44b4-9c6a-23881efe78a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.582353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267be2e-f221-44b4-9c6a-23881efe78a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.583026 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267be2e-f221-44b4-9c6a-23881efe78a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:38.583343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267be2e-f221-44b4-9c6a-23881efe78a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.584715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267be2e-f221-44b4-9c6a-23881efe78a4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.593500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 323/648] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:38.594368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267be2e-f221-44b4-9c6a-23881efe78a4 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.627534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:38.629338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaddc0-b137-4afa-9c4c-32957b687ee4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.668211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff697c5-3f06-48f3-ab27-8ed6fcb4b418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.668845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff697c5-3f06-48f3-ab27-8ed6fcb4b418 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.669123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff697c5-3f06-48f3-ab27-8ed6fcb4b418 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.669392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff697c5-3f06-48f3-ab27-8ed6fcb4b418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.679007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:38.682564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff697c5-3f06-48f3-ab27-8ed6fcb4b418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.684008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff697c5-3f06-48f3-ab27-8ed6fcb4b418 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-6ff697c5-3f06-48f3-ab27-8ed6fcb4b418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:38.700574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:38.701594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:38.702480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:38.702480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:38.702480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:38.702480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 326/649] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:38.702705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff697c5-3f06-48f3-ab27-8ed6fcb4b418 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.713722 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267be2e-f221-44b4-9c6a-23881efe78a4 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.755372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2a64f-b90e-4974-a416-bff908b8873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.756072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a64f-b90e-4974-a416-bff908b8873f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.756283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a64f-b90e-4974-a416-bff908b8873f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.756516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2a64f-b90e-4974-a416-bff908b8873f None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.757267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2a64f-b90e-4974-a416-bff908b8873f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:38.757569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2a64f-b90e-4974-a416-bff908b8873f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.759287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2a64f-b90e-4974-a416-bff908b8873f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.783776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 324/650] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:38.783776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2a64f-b90e-4974-a416-bff908b8873f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.825624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff697c5-3f06-48f3-ab27-8ed6fcb4b418 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.866233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d08be2-abc2-4988-b39d-181eea2863cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.866854 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d08be2-abc2-4988-b39d-181eea2863cd None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.867134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d08be2-abc2-4988-b39d-181eea2863cd None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.867406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d08be2-abc2-4988-b39d-181eea2863cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.868138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d08be2-abc2-4988-b39d-181eea2863cd None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=799cbde43a3643a4beef892d23145112) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:38.868445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d08be2-abc2-4988-b39d-181eea2863cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.870493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d08be2-abc2-4988-b39d-181eea2863cd None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:38.878219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 327/651] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/role_assignments?user.id=799cbde43a3643a4beef892d23145112&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:38.878923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d08be2-abc2-4988-b39d-181eea2863cd None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:38.888597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:38.914141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2a64f-b90e-4974-a416-bff908b8873f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:38.950987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:38.971723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c59d8-a189-4754-972b-1c332345a1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:38.973429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c59d8-a189-4754-972b-1c332345a1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:38.974614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c59d8-a189-4754-972b-1c332345a1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:38.975127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c59d8-a189-4754-972b-1c332345a1e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:38.990861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c59d8-a189-4754-972b-1c332345a1e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:38.992953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c59d8-a189-4754-972b-1c332345a1e8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.005187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d08be2-abc2-4988-b39d-181eea2863cd None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-a69c59d8-a189-4754-972b-1c332345a1e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:39.012071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:39.013088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:39.014045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:39.014045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:39.014045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:39.016347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 325/652] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:39.017523 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c59d8-a189-4754-972b-1c332345a1e8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.048079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84086d-9a94-4636-9a90-cfc4790210c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.048884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84086d-9a94-4636-9a90-cfc4790210c8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.049275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84086d-9a94-4636-9a90-cfc4790210c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.049619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84086d-9a94-4636-9a90-cfc4790210c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.050452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84086d-9a94-4636-9a90-cfc4790210c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:39.050784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84086d-9a94-4636-9a90-cfc4790210c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.053253 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84086d-9a94-4636-9a90-cfc4790210c8 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.066807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 328/653] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:39.067775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84086d-9a94-4636-9a90-cfc4790210c8 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.162723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c59d8-a189-4754-972b-1c332345a1e8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.200930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84086d-9a94-4636-9a90-cfc4790210c8 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.216656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672011f4-79a9-4e58-b207-988d294156f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.217995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672011f4-79a9-4e58-b207-988d294156f6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.219077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672011f4-79a9-4e58-b207-988d294156f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.219551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672011f4-79a9-4e58-b207-988d294156f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.221721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.238834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.245742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fddea-e824-478f-ae01-f5d77c9d0493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.246790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fddea-e824-478f-ae01-f5d77c9d0493 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.247326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fddea-e824-478f-ae01-f5d77c9d0493 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.247800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fddea-e824-478f-ae01-f5d77c9d0493 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.248519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fddea-e824-478f-ae01-f5d77c9d0493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:39.248887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fddea-e824-478f-ae01-f5d77c9d0493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.250457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fddea-e824-478f-ae01-f5d77c9d0493 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.265009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 329/654] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:39.266311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fddea-e824-478f-ae01-f5d77c9d0493 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.311946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672011f4-79a9-4e58-b207-988d294156f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.314490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672011f4-79a9-4e58-b207-988d294156f6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.391701 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fddea-e824-478f-ae01-f5d77c9d0493 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.432395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b9552-3d1d-4cff-b60d-a9ac013236b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.433458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9552-3d1d-4cff-b60d-a9ac013236b4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.433976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9552-3d1d-4cff-b60d-a9ac013236b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.434552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9552-3d1d-4cff-b60d-a9ac013236b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.444678 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b9552-3d1d-4cff-b60d-a9ac013236b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.446907 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b9552-3d1d-4cff-b60d-a9ac013236b4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.458059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 326/655] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:39.459319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672011f4-79a9-4e58-b207-988d294156f6 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-7d4b9552-3d1d-4cff-b60d-a9ac013236b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:39.459966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:39.460865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:39.461826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:39.461826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:39.461826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:39.461826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:39.461826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:39.461826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:39.461826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:39.461826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:39.461826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:08:39.461826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:39.466034 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 330/656] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:39.466990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b9552-3d1d-4cff-b60d-a9ac013236b4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.507916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.511298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.579113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672011f4-79a9-4e58-b207-988d294156f6 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.584050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b9552-3d1d-4cff-b60d-a9ac013236b4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.616234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac7502-abdd-4b21-8740-0b0c103e3ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.616880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac7502-abdd-4b21-8740-0b0c103e3ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.617163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac7502-abdd-4b21-8740-0b0c103e3ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.617440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac7502-abdd-4b21-8740-0b0c103e3ac3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.624669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfcb61-9f67-482b-afc6-8c9fc7e34531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.624961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac7502-abdd-4b21-8740-0b0c103e3ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.625655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfcb61-9f67-482b-afc6-8c9fc7e34531 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.626110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfcb61-9f67-482b-afc6-8c9fc7e34531 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.626444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac7502-abdd-4b21-8740-0b0c103e3ac3 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.626708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfcb61-9f67-482b-afc6-8c9fc7e34531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.638088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfcb61-9f67-482b-afc6-8c9fc7e34531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-4aac7502-abdd-4b21-8740-0b0c103e3ac3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:39.638612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:39.639690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 327/657] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:39.640650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac7502-abdd-4b21-8740-0b0c103e3ac3 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.642617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfcb61-9f67-482b-afc6-8c9fc7e34531 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-00bfcb61-9f67-482b-afc6-8c9fc7e34531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:39.661708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:39.662851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:39.664063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:39.664063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:39.664063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:39.667448 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 331/658] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:39.668740 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadad83-b660-4efa-8153-750c23863e1b None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.669153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadad83-b660-4efa-8153-750c23863e1b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.669446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadad83-b660-4efa-8153-750c23863e1b None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.671049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 332/659] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:39.671851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadad83-b660-4efa-8153-750c23863e1b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.753347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.758116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac7502-abdd-4b21-8740-0b0c103e3ac3 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.778033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.793740 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadad83-b660-4efa-8153-750c23863e1b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:39.800006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104041f2-434a-4253-a90e-0cf3202ce107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.800764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104041f2-434a-4253-a90e-0cf3202ce107 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.801579 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104041f2-434a-4253-a90e-0cf3202ce107 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.801822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104041f2-434a-4253-a90e-0cf3202ce107 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.802648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104041f2-434a-4253-a90e-0cf3202ce107 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:39.803147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104041f2-434a-4253-a90e-0cf3202ce107 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.804441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104041f2-434a-4253-a90e-0cf3202ce107 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.839400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 328/660] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:39.839400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104041f2-434a-4253-a90e-0cf3202ce107 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:39.851670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784340-8eb2-4513-adb8-7448547a1ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:39.852553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784340-8eb2-4513-adb8-7448547a1ebe None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.852839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784340-8eb2-4513-adb8-7448547a1ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.853115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784340-8eb2-4513-adb8-7448547a1ebe None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.853911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5784340-8eb2-4513-adb8-7448547a1ebe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:39.854221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5784340-8eb2-4513-adb8-7448547a1ebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:39.856598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5784340-8eb2-4513-adb8-7448547a1ebe None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:39.874317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 333/661] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:39.880541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a08538-78e2-4647-b620-8e4155a05ba1 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:39.880831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a08538-78e2-4647-b620-8e4155a05ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:39.881112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a08538-78e2-4647-b620-8e4155a05ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:39.899627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-37a08538-78e2-4647-b620-8e4155a05ba1 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:39.900833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-37a08538-78e2-4647-b620-8e4155a05ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:39.969715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 334/662] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:39.969715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a08538-78e2-4647-b620-8e4155a05ba1 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.004663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104041f2-434a-4253-a90e-0cf3202ce107 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.044563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc28beb-3366-4af2-8630-c41b6f08815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.045190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc28beb-3366-4af2-8630-c41b6f08815c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.045473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc28beb-3366-4af2-8630-c41b6f08815c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.045793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc28beb-3366-4af2-8630-c41b6f08815c None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.046453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc28beb-3366-4af2-8630-c41b6f08815c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:40.047003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc28beb-3366-4af2-8630-c41b6f08815c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.048893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc28beb-3366-4af2-8630-c41b6f08815c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.069458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 329/663] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:40.069458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc28beb-3366-4af2-8630-c41b6f08815c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.075822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.097010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.106203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a08538-78e2-4647-b620-8e4155a05ba1 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.154325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8ab04-7adc-4fc5-875e-720d9b74f54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.155504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8ab04-7adc-4fc5-875e-720d9b74f54a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.156134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8ab04-7adc-4fc5-875e-720d9b74f54a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.156515 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8ab04-7adc-4fc5-875e-720d9b74f54a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.211774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc28beb-3366-4af2-8630-c41b6f08815c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.234085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8ab04-7adc-4fc5-875e-720d9b74f54a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.235768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8ab04-7adc-4fc5-875e-720d9b74f54a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.255743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59579eb0-7929-4304-abaa-5030b1376866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.256731 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59579eb0-7929-4304-abaa-5030b1376866 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.257112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59579eb0-7929-4304-abaa-5030b1376866 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.257482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59579eb0-7929-4304-abaa-5030b1376866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.337291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.337899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59579eb0-7929-4304-abaa-5030b1376866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.339748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59579eb0-7929-4304-abaa-5030b1376866 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.362318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.375130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 335/664] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:40.376087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8ab04-7adc-4fc5-875e-720d9b74f54a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.470973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 330/665] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:40.471839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59579eb0-7929-4304-abaa-5030b1376866 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.514486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8ab04-7adc-4fc5-875e-720d9b74f54a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.554703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b42e8-b452-4b33-96a8-17bf25ac84ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.555373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b42e8-b452-4b33-96a8-17bf25ac84ea None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.555713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b42e8-b452-4b33-96a8-17bf25ac84ea None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.556024 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b42e8-b452-4b33-96a8-17bf25ac84ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.563784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b42e8-b452-4b33-96a8-17bf25ac84ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.565282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b42e8-b452-4b33-96a8-17bf25ac84ea None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-d00b42e8-b452-4b33-96a8-17bf25ac84ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:40.577978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:40.579091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:40.580376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:40.580376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:40.580376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:40.580376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:40.580376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:40.580376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:40.580376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:40.580376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:40.584569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 336/666] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:40.585271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b42e8-b452-4b33-96a8-17bf25ac84ea None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.595270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59579eb0-7929-4304-abaa-5030b1376866 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.616606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.627207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.638620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b918e1-7c9a-4aec-ac1c-0c0eb2f9634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.639288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b918e1-7c9a-4aec-ac1c-0c0eb2f9634f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.639562 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b918e1-7c9a-4aec-ac1c-0c0eb2f9634f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.639839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b918e1-7c9a-4aec-ac1c-0c0eb2f9634f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.655007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b918e1-7c9a-4aec-ac1c-0c0eb2f9634f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.657125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b918e1-7c9a-4aec-ac1c-0c0eb2f9634f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-b3b918e1-7c9a-4aec-ac1c-0c0eb2f9634f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:40.674549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:40.675822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:40.676701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:40.676701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:40.676701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:40.676701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 331/667] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:40.676921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b918e1-7c9a-4aec-ac1c-0c0eb2f9634f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.707579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b42e8-b452-4b33-96a8-17bf25ac84ea None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.747169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ae37c-7e4d-4989-bced-090940d09ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.747817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae37c-7e4d-4989-bced-090940d09ede None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.748097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae37c-7e4d-4989-bced-090940d09ede None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.748374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae37c-7e4d-4989-bced-090940d09ede None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.761319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ae37c-7e4d-4989-bced-090940d09ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-e82ae37c-7e4d-4989-bced-090940d09ede None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:40.766355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:40.767282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:40.768133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 337/668] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:40.770368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ae37c-7e4d-4989-bced-090940d09ede None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.799223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b918e1-7c9a-4aec-ac1c-0c0eb2f9634f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.843186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f495dbc-5b5c-42e9-89a1-084f2fae57a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.843874 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f495dbc-5b5c-42e9-89a1-084f2fae57a3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.844308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f495dbc-5b5c-42e9-89a1-084f2fae57a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.844648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f495dbc-5b5c-42e9-89a1-084f2fae57a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.857697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f495dbc-5b5c-42e9-89a1-084f2fae57a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.859330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f495dbc-5b5c-42e9-89a1-084f2fae57a3 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-2f495dbc-5b5c-42e9-89a1-084f2fae57a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:40.875655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:40.876829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:40.878303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:40.878303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:40.878303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:40.878303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 332/669] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:40.878303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f495dbc-5b5c-42e9-89a1-084f2fae57a3 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.879748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.887583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ae37c-7e4d-4989-bced-090940d09ede None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:40.901976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:40.924088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41775e-bbc4-44e7-8d3b-fc812b5c1e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:40.924712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41775e-bbc4-44e7-8d3b-fc812b5c1e37 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:40.924996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41775e-bbc4-44e7-8d3b-fc812b5c1e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:40.925336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41775e-bbc4-44e7-8d3b-fc812b5c1e37 None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:40.926588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41775e-bbc4-44e7-8d3b-fc812b5c1e37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:40.926900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41775e-bbc4-44e7-8d3b-fc812b5c1e37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:40.928342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41775e-bbc4-44e7-8d3b-fc812b5c1e37 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:40.945932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 338/670] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:40.945932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41775e-bbc4-44e7-8d3b-fc812b5c1e37 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:40.993816 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f495dbc-5b5c-42e9-89a1-084f2fae57a3 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.030007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdefaf1-db97-41e8-9f52-7a086eb37794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.030530 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdefaf1-db97-41e8-9f52-7a086eb37794 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.030811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdefaf1-db97-41e8-9f52-7a086eb37794 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.031083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdefaf1-db97-41e8-9f52-7a086eb37794 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.031727 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdefaf1-db97-41e8-9f52-7a086eb37794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.032031 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdefaf1-db97-41e8-9f52-7a086eb37794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.033484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdefaf1-db97-41e8-9f52-7a086eb37794 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.045455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 333/671] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:41.046322 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdefaf1-db97-41e8-9f52-7a086eb37794 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.056993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41775e-bbc4-44e7-8d3b-fc812b5c1e37 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.092264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aff580-3bdd-4222-82dd-7d3420146cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.092883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aff580-3bdd-4222-82dd-7d3420146cae None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.093166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aff580-3bdd-4222-82dd-7d3420146cae None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.093445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aff580-3bdd-4222-82dd-7d3420146cae None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.094147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aff580-3bdd-4222-82dd-7d3420146cae None admin] RBAC: Adding query filter params (name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.094453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aff580-3bdd-4222-82dd-7d3420146cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.095833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aff580-3bdd-4222-82dd-7d3420146cae None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.104278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 339/672] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:41.105084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aff580-3bdd-4222-82dd-7d3420146cae None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.124247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.140249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.162327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdefaf1-db97-41e8-9f52-7a086eb37794 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.199240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348a99c-6ea0-4ea6-871f-5b6013ec9168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.199953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348a99c-6ea0-4ea6-871f-5b6013ec9168 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.200234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348a99c-6ea0-4ea6-871f-5b6013ec9168 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.200512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348a99c-6ea0-4ea6-871f-5b6013ec9168 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.201155 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348a99c-6ea0-4ea6-871f-5b6013ec9168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.201456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348a99c-6ea0-4ea6-871f-5b6013ec9168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.202874 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348a99c-6ea0-4ea6-871f-5b6013ec9168 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.211208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aff580-3bdd-4222-82dd-7d3420146cae None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.214970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 334/673] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:41.216261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbd278-6d68-48b0-ab17-ae7e5715ba0d None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.216545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbd278-6d68-48b0-ab17-ae7e5715ba0d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.216819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbd278-6d68-48b0-ab17-ae7e5715ba0d None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.222283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 335/674] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:41.222283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbd278-6d68-48b0-ab17-ae7e5715ba0d None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.252291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776fa0-3fc1-4c47-9a2d-a8ad9bf0e941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.252891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776fa0-3fc1-4c47-9a2d-a8ad9bf0e941 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.253172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776fa0-3fc1-4c47-9a2d-a8ad9bf0e941 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.253996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776fa0-3fc1-4c47-9a2d-a8ad9bf0e941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.254865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f776fa0-3fc1-4c47-9a2d-a8ad9bf0e941 None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=b263d1092fc148129020ba73f2b8fbd3) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.255173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f776fa0-3fc1-4c47-9a2d-a8ad9bf0e941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.256606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f776fa0-3fc1-4c47-9a2d-a8ad9bf0e941 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.262765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 340/675] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/role_assignments?user.id=b263d1092fc148129020ba73f2b8fbd3&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:41.263594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776fa0-3fc1-4c47-9a2d-a8ad9bf0e941 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.358095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbd278-6d68-48b0-ab17-ae7e5715ba0d None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.367456 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.389090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776fa0-3fc1-4c47-9a2d-a8ad9bf0e941 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.400226 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183ff24-1ae6-47c1-8d9d-4032c17826e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.401278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183ff24-1ae6-47c1-8d9d-4032c17826e4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.401574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183ff24-1ae6-47c1-8d9d-4032c17826e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.401883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183ff24-1ae6-47c1-8d9d-4032c17826e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.409548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183ff24-1ae6-47c1-8d9d-4032c17826e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.411055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183ff24-1ae6-47c1-8d9d-4032c17826e4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.415299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-c183ff24-1ae6-47c1-8d9d-4032c17826e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:41.423342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:41.427185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:41.428108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:41.428108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:41.428108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:41.428108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:41.428108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:41.428108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:41.428108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:41.428108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:41.428108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 336/676] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:41.428108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183ff24-1ae6-47c1-8d9d-4032c17826e4 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.436670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640e578-d2d7-480f-b584-31fa597fc61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.437319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640e578-d2d7-480f-b584-31fa597fc61b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.437606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640e578-d2d7-480f-b584-31fa597fc61b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.437913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640e578-d2d7-480f-b584-31fa597fc61b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.450662 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640e578-d2d7-480f-b584-31fa597fc61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.452129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640e578-d2d7-480f-b584-31fa597fc61b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-3640e578-d2d7-480f-b584-31fa597fc61b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:41.468305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:41.469375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:41.470944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:41.470944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:41.470944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:41.470944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 341/677] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:41.471570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457a9f-e67e-42ed-bab5-2ebc07f258e6 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.471880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457a9f-e67e-42ed-bab5-2ebc07f258e6 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.472197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457a9f-e67e-42ed-bab5-2ebc07f258e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.497106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9d457a9f-e67e-42ed-bab5-2ebc07f258e6 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:41.498330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9d457a9f-e67e-42ed-bab5-2ebc07f258e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:41.552708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183ff24-1ae6-47c1-8d9d-4032c17826e4 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.582417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 342/678] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:41.583245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d457a9f-e67e-42ed-bab5-2ebc07f258e6 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.606191 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd978-fb2f-4bc2-b09e-2704602019ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.606861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd978-fb2f-4bc2-b09e-2704602019ad None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.607150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd978-fb2f-4bc2-b09e-2704602019ad None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.607427 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd978-fb2f-4bc2-b09e-2704602019ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.618277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dd978-fb2f-4bc2-b09e-2704602019ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.619856 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dd978-fb2f-4bc2-b09e-2704602019ad None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-146dd978-fb2f-4bc2-b09e-2704602019ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:41.635649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:41.636624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:41.637537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:41.637537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:41.637537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:41.637537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:41.637537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:41.637537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:41.637537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:41.637537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:41.637537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 337/679] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:41.638067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd978-fb2f-4bc2-b09e-2704602019ad None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.663349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.713093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d457a9f-e67e-42ed-bab5-2ebc07f258e6 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.716219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.752733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924142bc-c9cc-42b9-9d3d-75c8c17f5a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.753769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924142bc-c9cc-42b9-9d3d-75c8c17f5a1e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.753769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924142bc-c9cc-42b9-9d3d-75c8c17f5a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.754007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924142bc-c9cc-42b9-9d3d-75c8c17f5a1e None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.754692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924142bc-c9cc-42b9-9d3d-75c8c17f5a1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.754998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924142bc-c9cc-42b9-9d3d-75c8c17f5a1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.756415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924142bc-c9cc-42b9-9d3d-75c8c17f5a1e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.763916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd978-fb2f-4bc2-b09e-2704602019ad None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.769689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 343/680] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:41.770602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924142bc-c9cc-42b9-9d3d-75c8c17f5a1e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.802491 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6471-1223-4e2f-8c8c-faaaf6f33d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.803516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6471-1223-4e2f-8c8c-faaaf6f33d58 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.804008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6471-1223-4e2f-8c8c-faaaf6f33d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.804524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6471-1223-4e2f-8c8c-faaaf6f33d58 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.805414 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6471-1223-4e2f-8c8c-faaaf6f33d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.805961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6471-1223-4e2f-8c8c-faaaf6f33d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.807668 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6471-1223-4e2f-8c8c-faaaf6f33d58 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.826182 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 338/681] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:41.827482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6471-1223-4e2f-8c8c-faaaf6f33d58 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.881052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924142bc-c9cc-42b9-9d3d-75c8c17f5a1e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.907220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.918562 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb46043-18db-4bd3-a99e-76d00f81c000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.919174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb46043-18db-4bd3-a99e-76d00f81c000 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.934643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb46043-18db-4bd3-a99e-76d00f81c000 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.934643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb46043-18db-4bd3-a99e-76d00f81c000 None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.934643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb46043-18db-4bd3-a99e-76d00f81c000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.934643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb46043-18db-4bd3-a99e-76d00f81c000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.934643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb46043-18db-4bd3-a99e-76d00f81c000 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.936476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6471-1223-4e2f-8c8c-faaaf6f33d58 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:41.937831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 344/682] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:41.939026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb46043-18db-4bd3-a99e-76d00f81c000 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:41.962635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:41.978589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778c63f-3b7a-44a6-8e6f-c50320aa6ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:41.979208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c63f-3b7a-44a6-8e6f-c50320aa6ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:41.979493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c63f-3b7a-44a6-8e6f-c50320aa6ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:41.979770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c63f-3b7a-44a6-8e6f-c50320aa6ae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:41.980578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778c63f-3b7a-44a6-8e6f-c50320aa6ae8 None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=953c57f22b304dcda6fcaba3fb01d666) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:41.980898 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778c63f-3b7a-44a6-8e6f-c50320aa6ae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:41.982388 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778c63f-3b7a-44a6-8e6f-c50320aa6ae8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:41.997894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 339/683] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/role_assignments?user.id=953c57f22b304dcda6fcaba3fb01d666&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:41.999266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778c63f-3b7a-44a6-8e6f-c50320aa6ae8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.059708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb46043-18db-4bd3-a99e-76d00f81c000 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.102894 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff49b5-e7e6-4210-b20d-b478799879a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.103324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff49b5-e7e6-4210-b20d-b478799879a9 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.103619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff49b5-e7e6-4210-b20d-b478799879a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.103897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff49b5-e7e6-4210-b20d-b478799879a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.112465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff49b5-e7e6-4210-b20d-b478799879a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.114121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff49b5-e7e6-4210-b20d-b478799879a9 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-daff49b5-e7e6-4210-b20d-b478799879a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:42.127828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:42.128869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:42.129795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 345/684] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:42.130946 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff49b5-e7e6-4210-b20d-b478799879a9 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.153235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778c63f-3b7a-44a6-8e6f-c50320aa6ae8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.191905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d55b20-8234-4512-94d9-649ba1448746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.192548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d55b20-8234-4512-94d9-649ba1448746 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.192865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d55b20-8234-4512-94d9-649ba1448746 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.193116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:42.193227 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d55b20-8234-4512-94d9-649ba1448746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.207640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d55b20-8234-4512-94d9-649ba1448746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-a0d55b20-8234-4512-94d9-649ba1448746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:42.213256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:42.214380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:42.215210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 340/685] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:42.216010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d55b20-8234-4512-94d9-649ba1448746 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.280783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff49b5-e7e6-4210-b20d-b478799879a9 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.310160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:42.326304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c68a-54c7-4fbf-b939-c3457d473895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.327738 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c68a-54c7-4fbf-b939-c3457d473895 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.328015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c68a-54c7-4fbf-b939-c3457d473895 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.328284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c68a-54c7-4fbf-b939-c3457d473895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.329029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c68a-54c7-4fbf-b939-c3457d473895 None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=f14e5614aee44c59a47b12e5b35ea3fa) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:42.329336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c68a-54c7-4fbf-b939-c3457d473895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.330851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c68a-54c7-4fbf-b939-c3457d473895 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.341838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 346/686] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/role_assignments?user.id=f14e5614aee44c59a47b12e5b35ea3fa&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:42.341838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c68a-54c7-4fbf-b939-c3457d473895 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.366144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d55b20-8234-4512-94d9-649ba1448746 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.482457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe3437-c7cc-49db-8857-52971efbca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.483090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe3437-c7cc-49db-8857-52971efbca75 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.483373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe3437-c7cc-49db-8857-52971efbca75 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.483647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe3437-c7cc-49db-8857-52971efbca75 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.484407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe3437-c7cc-49db-8857-52971efbca75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:42.484719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe3437-c7cc-49db-8857-52971efbca75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.486228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe3437-c7cc-49db-8857-52971efbca75 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.487806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c68a-54c7-4fbf-b939-c3457d473895 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.498667 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:42.520144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 341/687] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:42.525916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe3437-c7cc-49db-8857-52971efbca75 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.530267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648a54e-66c1-4b7e-9958-b40f9efa56ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.530963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a54e-66c1-4b7e-9958-b40f9efa56ac None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.531328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a54e-66c1-4b7e-9958-b40f9efa56ac None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.531667 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a54e-66c1-4b7e-9958-b40f9efa56ac None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.532473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648a54e-66c1-4b7e-9958-b40f9efa56ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:42.532838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648a54e-66c1-4b7e-9958-b40f9efa56ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.534317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648a54e-66c1-4b7e-9958-b40f9efa56ac None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.545112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 347/688] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:42.553575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648a54e-66c1-4b7e-9958-b40f9efa56ac None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.652412 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe3437-c7cc-49db-8857-52971efbca75 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.654202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:42.695036 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648a54e-66c1-4b7e-9958-b40f9efa56ac None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.700970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebeb97-fac3-4170-a787-74f7b199ee41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.701653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebeb97-fac3-4170-a787-74f7b199ee41 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.701971 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebeb97-fac3-4170-a787-74f7b199ee41 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.702297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebeb97-fac3-4170-a787-74f7b199ee41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.738179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b73cec-e3a6-4510-9cfc-128bb087368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.738788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b73cec-e3a6-4510-9cfc-128bb087368d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.739074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b73cec-e3a6-4510-9cfc-128bb087368d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.739354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b73cec-e3a6-4510-9cfc-128bb087368d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.755729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b73cec-e3a6-4510-9cfc-128bb087368d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.758247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b73cec-e3a6-4510-9cfc-128bb087368d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-a9b73cec-e3a6-4510-9cfc-128bb087368d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:42.781013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:42.782147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:42.783050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:42.783050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:42.783050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:42.783050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 348/689] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:42.792019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b73cec-e3a6-4510-9cfc-128bb087368d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.798410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebeb97-fac3-4170-a787-74f7b199ee41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.799993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebeb97-fac3-4170-a787-74f7b199ee41 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:42.840408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:42.933401 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 342/690] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:42.935301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b73cec-e3a6-4510-9cfc-128bb087368d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:42.939055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebeb97-fac3-4170-a787-74f7b199ee41 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:42.941761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:42.989774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45365b67-d43e-4902-9530-da8559529f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:42.989774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45365b67-d43e-4902-9530-da8559529f05 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:42.989774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45365b67-d43e-4902-9530-da8559529f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:42.989774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45365b67-d43e-4902-9530-da8559529f05 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:42.990186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45365b67-d43e-4902-9530-da8559529f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:42.990186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45365b67-d43e-4902-9530-da8559529f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:42.990186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45365b67-d43e-4902-9530-da8559529f05 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.017031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 349/691] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:43.025327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45365b67-d43e-4902-9530-da8559529f05 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.133012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebeb97-fac3-4170-a787-74f7b199ee41 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.162250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:43.186718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45365b67-d43e-4902-9530-da8559529f05 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.245264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d6f49-750f-475c-be6c-27f8e6d01312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.246375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d6f49-750f-475c-be6c-27f8e6d01312 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.246864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d6f49-750f-475c-be6c-27f8e6d01312 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.247338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d6f49-750f-475c-be6c-27f8e6d01312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.248530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3077-bb06-40ba-8db3-0ae3a4eda310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.249273 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3077-bb06-40ba-8db3-0ae3a4eda310 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.249734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3077-bb06-40ba-8db3-0ae3a4eda310 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.250213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3077-bb06-40ba-8db3-0ae3a4eda310 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.266686 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c3077-bb06-40ba-8db3-0ae3a4eda310 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.268161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c3077-bb06-40ba-8db3-0ae3a4eda310 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.275909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d6f49-750f-475c-be6c-27f8e6d01312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.281062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d6f49-750f-475c-be6c-27f8e6d01312 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-a77c3077-bb06-40ba-8db3-0ae3a4eda310 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:43.288399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:43.289367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:43.290297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:43.290297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:43.290297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:43.290297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:43.290297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:43.290297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:43.290297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:43.290297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:43.290297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:43.290297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:43.295398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 350/692] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:43.305962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3077-bb06-40ba-8db3-0ae3a4eda310 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-fa8d6f49-750f-475c-be6c-27f8e6d01312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:43.309552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:43.310551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:43.312550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:43.312550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:43.312550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:43.312550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 343/693] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:43.323258 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d6f49-750f-475c-be6c-27f8e6d01312 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.442342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3077-bb06-40ba-8db3-0ae3a4eda310 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.445134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:43.499438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd945c2-73b4-4f85-ace1-341b37325f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.500295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd945c2-73b4-4f85-ace1-341b37325f5b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.500991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd945c2-73b4-4f85-ace1-341b37325f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.501258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd945c2-73b4-4f85-ace1-341b37325f5b None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.502487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd945c2-73b4-4f85-ace1-341b37325f5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:43.502968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd945c2-73b4-4f85-ace1-341b37325f5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.506193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd945c2-73b4-4f85-ace1-341b37325f5b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.521910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d6f49-750f-475c-be6c-27f8e6d01312 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.529085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:43.534758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 351/694] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:43.536570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b5933-3947-4793-988f-b0364172c0d1 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.537179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b5933-3947-4793-988f-b0364172c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.537567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b5933-3947-4793-988f-b0364172c0d1 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.545403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 352/695] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:43.547019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b5933-3947-4793-988f-b0364172c0d1 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.564225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8b58e-3cee-436a-9632-fd132144f42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.564849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8b58e-3cee-436a-9632-fd132144f42a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.565135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8b58e-3cee-436a-9632-fd132144f42a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.565406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8b58e-3cee-436a-9632-fd132144f42a None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.567225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8b58e-3cee-436a-9632-fd132144f42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:43.567547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8b58e-3cee-436a-9632-fd132144f42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.569002 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8b58e-3cee-436a-9632-fd132144f42a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.584843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 344/696] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:43.586803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd2521-90f2-46e1-810f-0c8692f2daf4 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.587088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd2521-90f2-46e1-810f-0c8692f2daf4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.587360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd2521-90f2-46e1-810f-0c8692f2daf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.611025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-f5dd2521-90f2-46e1-810f-0c8692f2daf4 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:43.612614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f5dd2521-90f2-46e1-810f-0c8692f2daf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:43.687124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b5933-3947-4793-988f-b0364172c0d1 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.711334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 345/697] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:43.712230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd2521-90f2-46e1-810f-0c8692f2daf4 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:43.740012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dccf9c-d8f9-44d6-b6cb-f3bf89721ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.740733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dccf9c-d8f9-44d6-b6cb-f3bf89721ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.741015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dccf9c-d8f9-44d6-b6cb-f3bf89721ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.741292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dccf9c-d8f9-44d6-b6cb-f3bf89721ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.766442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:43.839055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd2521-90f2-46e1-810f-0c8692f2daf4 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:43.884689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:43.886889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa6fff-5036-4143-939c-0758fa90b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:43.887548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa6fff-5036-4143-939c-0758fa90b8fa None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:43.887828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa6fff-5036-4143-939c-0758fa90b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:43.888311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa6fff-5036-4143-939c-0758fa90b8fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:43.889919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dccf9c-d8f9-44d6-b6cb-f3bf89721ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.891440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dccf9c-d8f9-44d6-b6cb-f3bf89721ad8 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.899528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa6fff-5036-4143-939c-0758fa90b8fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:43.901514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa6fff-5036-4143-939c-0758fa90b8fa None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-43fa6fff-5036-4143-939c-0758fa90b8fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:43.929697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:43.930705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:43.931641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:43.931641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:43.931641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:43.931641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:43.931641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:43.931641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:43.931641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:43.931641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:43.935910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 346/698] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:43.942934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa6fff-5036-4143-939c-0758fa90b8fa None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:44.057789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa6fff-5036-4143-939c-0758fa90b8fa None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:44.061595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:44.109810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed0fcd-fc4b-4125-9579-87180d59c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:44.120566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed0fcd-fc4b-4125-9579-87180d59c4bc None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.120566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed0fcd-fc4b-4125-9579-87180d59c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.120566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed0fcd-fc4b-4125-9579-87180d59c4bc None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.120566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed0fcd-fc4b-4125-9579-87180d59c4bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:44.120566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed0fcd-fc4b-4125-9579-87180d59c4bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:44.120566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed0fcd-fc4b-4125-9579-87180d59c4bc None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:44.121232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 353/699] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:08:44.122514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dccf9c-d8f9-44d6-b6cb-f3bf89721ad8 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:44.129154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 347/700] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:44.130051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed0fcd-fc4b-4125-9579-87180d59c4bc None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:44.241454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:44.243105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed0fcd-fc4b-4125-9579-87180d59c4bc None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:44.246186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dccf9c-d8f9-44d6-b6cb-f3bf89721ad8 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:44.280528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bba61-9967-44e8-8c3a-63fbdd5655d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:44.281134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bba61-9967-44e8-8c3a-63fbdd5655d5 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.281421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bba61-9967-44e8-8c3a-63fbdd5655d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.281715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bba61-9967-44e8-8c3a-63fbdd5655d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.287970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69a366-07ec-427c-8b43-988916e5f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:44.288908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a366-07ec-427c-8b43-988916e5f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.289493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a366-07ec-427c-8b43-988916e5f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.290003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a366-07ec-427c-8b43-988916e5f2f0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.290820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69a366-07ec-427c-8b43-988916e5f2f0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:44.292484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69a366-07ec-427c-8b43-988916e5f2f0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:44.293562 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bba61-9967-44e8-8c3a-63fbdd5655d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:44.295055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bba61-9967-44e8-8c3a-63fbdd5655d5 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-aa69a366-07ec-427c-8b43-988916e5f2f0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:44.304880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:44.306179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:44.307116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-216bba61-9967-44e8-8c3a-63fbdd5655d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:44.313142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:44.314070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:44.314940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:44.314940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:44.314940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:44.314940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 348/701] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:44.314940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bba61-9967-44e8-8c3a-63fbdd5655d5 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:44.315215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 354/702] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:44 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:44.319534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69a366-07ec-427c-8b43-988916e5f2f0 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:44.340728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:44.452467 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69a366-07ec-427c-8b43-988916e5f2f0 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:44.486660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bba61-9967-44e8-8c3a-63fbdd5655d5 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:44.497551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1537a-ea8a-4d93-b313-dac000e64723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:44.498216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1537a-ea8a-4d93-b313-dac000e64723 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.498548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1537a-ea8a-4d93-b313-dac000e64723 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.498832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1537a-ea8a-4d93-b313-dac000e64723 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.499619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1537a-ea8a-4d93-b313-dac000e64723 None admin] RBAC: Adding query filter params (name=network) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:44.503589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1537a-ea8a-4d93-b313-dac000e64723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:44.503589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1537a-ea8a-4d93-b313-dac000e64723 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:44.513183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 355/703] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:44.513183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1537a-ea8a-4d93-b313-dac000e64723 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:44.545352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6caa-e97d-4293-ac47-ed33d5474af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:44.545999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6caa-e97d-4293-ac47-ed33d5474af7 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.546277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6caa-e97d-4293-ac47-ed33d5474af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.546548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6caa-e97d-4293-ac47-ed33d5474af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.547285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd6caa-e97d-4293-ac47-ed33d5474af7 None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=78c331b659da48549c4c91e659ff83ba) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:44.547592 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd6caa-e97d-4293-ac47-ed33d5474af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:44.549024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd6caa-e97d-4293-ac47-ed33d5474af7 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:44.565788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 349/704] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:44 2022] GET /identity/v3/role_assignments?user.id=78c331b659da48549c4c91e659ff83ba&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:44.565788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6caa-e97d-4293-ac47-ed33d5474af7 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:44.572385 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:44.690360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1537a-ea8a-4d93-b313-dac000e64723 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:44.692139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:44.716396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6caa-e97d-4293-ac47-ed33d5474af7 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:44.746926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2e707-bbc7-430d-aa53-74b863179fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:44.746926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e707-bbc7-430d-aa53-74b863179fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.746926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e707-bbc7-430d-aa53-74b863179fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.746926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e707-bbc7-430d-aa53-74b863179fe7 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.747367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2e707-bbc7-430d-aa53-74b863179fe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:44.747367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2e707-bbc7-430d-aa53-74b863179fe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:44.747367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2e707-bbc7-430d-aa53-74b863179fe7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:44.760524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 356/705] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:44.761918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e502dc7-d4d8-4b57-abcf-06ca9cb1d9a4 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.762208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e502dc7-d4d8-4b57-abcf-06ca9cb1d9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.762485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e502dc7-d4d8-4b57-abcf-06ca9cb1d9a4 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.767058 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4da6-3f31-4026-991f-b3eb281a692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:44.767922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 357/706] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:44.768116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4da6-3f31-4026-991f-b3eb281a692b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.768404 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4da6-3f31-4026-991f-b3eb281a692b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.768825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e502dc7-d4d8-4b57-abcf-06ca9cb1d9a4 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:44.769683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4da6-3f31-4026-991f-b3eb281a692b None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.770510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4da6-3f31-4026-991f-b3eb281a692b None admin] RBAC: Adding query filter params (type=network) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:44.770925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4da6-3f31-4026-991f-b3eb281a692b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:44.772539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4da6-3f31-4026-991f-b3eb281a692b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:44.781861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 350/707] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:44.783797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6df409-c98a-424e-a1b7-21af80939a0e None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.784108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6df409-c98a-424e-a1b7-21af80939a0e None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.784735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6df409-c98a-424e-a1b7-21af80939a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.808410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-6d6df409-c98a-424e-a1b7-21af80939a0e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:44.809872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6d6df409-c98a-424e-a1b7-21af80939a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:44.898942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:44.918465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e502dc7-d4d8-4b57-abcf-06ca9cb1d9a4 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:44.929973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 351/708] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:44.968280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed94a4-2c4e-4481-8ea6-7153a10e06b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:44.969122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed94a4-2c4e-4481-8ea6-7153a10e06b3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:44.969567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed94a4-2c4e-4481-8ea6-7153a10e06b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:44.970074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed94a4-2c4e-4481-8ea6-7153a10e06b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:44.980442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed94a4-2c4e-4481-8ea6-7153a10e06b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:44.982001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed94a4-2c4e-4481-8ea6-7153a10e06b3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-52ed94a4-2c4e-4481-8ea6-7153a10e06b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:45.001244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:45.002249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:45.003119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:45.003119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:45.003119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:45.003119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:45.003119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:45.003119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:45.003119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:45.003119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:45.003119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 358/709] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:45.008800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6df409-c98a-424e-a1b7-21af80939a0e None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:45.133749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:45.169652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6df409-c98a-424e-a1b7-21af80939a0e None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:45.211960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed94a4-2c4e-4481-8ea6-7153a10e06b3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:45.224036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd077eb8-91bf-4d69-a6f9-537c2e5d567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:45.224670 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077eb8-91bf-4d69-a6f9-537c2e5d567f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.224955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077eb8-91bf-4d69-a6f9-537c2e5d567f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.225922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077eb8-91bf-4d69-a6f9-537c2e5d567f None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.227069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd077eb8-91bf-4d69-a6f9-537c2e5d567f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:45.227894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd077eb8-91bf-4d69-a6f9-537c2e5d567f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:45.229662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd077eb8-91bf-4d69-a6f9-537c2e5d567f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:45.256372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 352/710] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:45.262380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd077eb8-91bf-4d69-a6f9-537c2e5d567f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:45.421782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed94a4-2c4e-4481-8ea6-7153a10e06b3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:45.480178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0571a-3563-4fee-923e-04348945c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:45.480832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0571a-3563-4fee-923e-04348945c94e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.481117 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0571a-3563-4fee-923e-04348945c94e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.481417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0571a-3563-4fee-923e-04348945c94e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.482071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0571a-3563-4fee-923e-04348945c94e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:45.483485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0571a-3563-4fee-923e-04348945c94e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:45.492909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd077eb8-91bf-4d69-a6f9-537c2e5d567f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-d0d0571a-3563-4fee-923e-04348945c94e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:45.501783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:45.502846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:45.503703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 359/711] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 31 19:08:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:45.514337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0571a-3563-4fee-923e-04348945c94e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:45.549384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:45.573452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05181887-db85-4b21-8205-cdf826f16520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:45.574116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05181887-db85-4b21-8205-cdf826f16520 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.574385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05181887-db85-4b21-8205-cdf826f16520 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.574668 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05181887-db85-4b21-8205-cdf826f16520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.576169 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05181887-db85-4b21-8205-cdf826f16520 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=799cbde43a3643a4beef892d23145112) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:45.576169 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05181887-db85-4b21-8205-cdf826f16520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:45.577185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05181887-db85-4b21-8205-cdf826f16520 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:45.579303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:45.589120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 353/712] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:45 2022] GET /identity/v3/role_assignments?user.id=799cbde43a3643a4beef892d23145112&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:45.611964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390b8d2-9778-4c81-a347-12702babfb4e None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.617701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390b8d2-9778-4c81-a347-12702babfb4e None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.617701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390b8d2-9778-4c81-a347-12702babfb4e None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.617701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 354/713] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:45.620938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6903c-31ba-4b90-8c15-be33a94965f2 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.621213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6903c-31ba-4b90-8c15-be33a94965f2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.621498 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6903c-31ba-4b90-8c15-be33a94965f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.642202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-67e6903c-31ba-4b90-8c15-be33a94965f2 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:45.644125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-67e6903c-31ba-4b90-8c15-be33a94965f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:45.706089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0571a-3563-4fee-923e-04348945c94e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:45.782591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 355/714] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:08:45.783359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f000-56e9-4ddb-8ff5-bc7629beeeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:45.784007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f000-56e9-4ddb-8ff5-bc7629beeeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:45.784292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f000-56e9-4ddb-8ff5-bc7629beeeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:45.785127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f000-56e9-4ddb-8ff5-bc7629beeeb4 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:45.785828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034f000-56e9-4ddb-8ff5-bc7629beeeb4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:45.786141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034f000-56e9-4ddb-8ff5-bc7629beeeb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:45.787569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034f000-56e9-4ddb-8ff5-bc7629beeeb4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:45.798084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 360/715] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:45.803450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6903c-31ba-4b90-8c15-be33a94965f2 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:45.957036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6903c-31ba-4b90-8c15-be33a94965f2 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:45.996852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:46.012014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9597c-fea6-4707-9f43-b9602b31f6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.013477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9597c-fea6-4707-9f43-b9602b31f6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.013931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9597c-fea6-4707-9f43-b9602b31f6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.014350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9597c-fea6-4707-9f43-b9602b31f6d8 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.015190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9597c-fea6-4707-9f43-b9602b31f6d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:46.015642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9597c-fea6-4707-9f43-b9602b31f6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.017174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9597c-fea6-4707-9f43-b9602b31f6d8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.023812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 356/716] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:46.172059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f000-56e9-4ddb-8ff5-bc7629beeeb4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.282614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:46.308933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f000-56e9-4ddb-8ff5-bc7629beeeb4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.348999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aeca7-e1f7-4e8e-8056-a2310ebe414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.349973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aeca7-e1f7-4e8e-8056-a2310ebe414d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.350458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aeca7-e1f7-4e8e-8056-a2310ebe414d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.350901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aeca7-e1f7-4e8e-8056-a2310ebe414d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.362442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aeca7-e1f7-4e8e-8056-a2310ebe414d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.364226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aeca7-e1f7-4e8e-8056-a2310ebe414d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-937aeca7-e1f7-4e8e-8056-a2310ebe414d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:46.382192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:46.383344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:46.384421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:46.384421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:46.384421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:46.386252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 361/717] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:46.392312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9597c-fea6-4707-9f43-b9602b31f6d8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.508139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9597c-fea6-4707-9f43-b9602b31f6d8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.544843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb0af7-ecbc-473b-bcbc-ec8650c086f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.545736 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb0af7-ecbc-473b-bcbc-ec8650c086f4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.546203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb0af7-ecbc-473b-bcbc-ec8650c086f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.546621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb0af7-ecbc-473b-bcbc-ec8650c086f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.547419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb0af7-ecbc-473b-bcbc-ec8650c086f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:46.547866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb0af7-ecbc-473b-bcbc-ec8650c086f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.549456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb0af7-ecbc-473b-bcbc-ec8650c086f4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.562884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 357/718] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:46.569321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aeca7-e1f7-4e8e-8056-a2310ebe414d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:46.701309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aeca7-e1f7-4e8e-8056-a2310ebe414d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:46.732903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:46.746619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc79b47-cfff-4f20-afca-39c58e662551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:46.747245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc79b47-cfff-4f20-afca-39c58e662551 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:46.747641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc79b47-cfff-4f20-afca-39c58e662551 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:46.747926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc79b47-cfff-4f20-afca-39c58e662551 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:46.748613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc79b47-cfff-4f20-afca-39c58e662551 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:46.750106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc79b47-cfff-4f20-afca-39c58e662551 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:46.866074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 362/719] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:08:46 2022] POST /identity/v3/users => generated 254 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:47.164642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f2807-7e90-4ebe-828e-7d6bf89d84c9 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.165151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f2807-7e90-4ebe-828e-7d6bf89d84c9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.165151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f2807-7e90-4ebe-828e-7d6bf89d84c9 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.166931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 358/720] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:47.173608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39ab38-2ea5-469b-9d17-79a37703fb5c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.173941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39ab38-2ea5-469b-9d17-79a37703fb5c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.174213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39ab38-2ea5-469b-9d17-79a37703fb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.195100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-2b39ab38-2ea5-469b-9d17-79a37703fb5c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:47.196569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2b39ab38-2ea5-469b-9d17-79a37703fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:47.295557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 363/721] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:47.342951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48676a74-3e2d-4427-923c-367d824943fc None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.343456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48676a74-3e2d-4427-923c-367d824943fc None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.343960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48676a74-3e2d-4427-923c-367d824943fc None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.347863 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 359/722] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:47.352805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51502e34-ec64-4441-b3cc-a5388e935401 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.353129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51502e34-ec64-4441-b3cc-a5388e935401 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.353372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51502e34-ec64-4441-b3cc-a5388e935401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.376280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-51502e34-ec64-4441-b3cc-a5388e935401 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:47.377564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-51502e34-ec64-4441-b3cc-a5388e935401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:47.462099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 364/723] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:47.721801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48676a74-3e2d-4427-923c-367d824943fc None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:47.770275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51502e34-ec64-4441-b3cc-a5388e935401 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:47.786945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:47.842441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48676a74-3e2d-4427-923c-367d824943fc None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:47.883808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d777aa-4efa-4ce3-9d38-95701bc8fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:47.884964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d777aa-4efa-4ce3-9d38-95701bc8fdaa None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:47.885403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d777aa-4efa-4ce3-9d38-95701bc8fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:47.885712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d777aa-4efa-4ce3-9d38-95701bc8fdaa None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:47.886653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d777aa-4efa-4ce3-9d38-95701bc8fdaa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:47.888100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d777aa-4efa-4ce3-9d38-95701bc8fdaa None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:47.914098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:47.997880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 360/724] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:47 2022] POST /identity/v3/services => generated 240 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:48.008520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51502e34-ec64-4441-b3cc-a5388e935401 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:48.058622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a230f5a-718d-41da-8e70-c6aab95c3f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:48.060238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a230f5a-718d-41da-8e70-c6aab95c3f89 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.069019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a230f5a-718d-41da-8e70-c6aab95c3f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.069624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a230f5a-718d-41da-8e70-c6aab95c3f89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.091258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a230f5a-718d-41da-8e70-c6aab95c3f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-2a230f5a-718d-41da-8e70-c6aab95c3f89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:48.099112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:48.100125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:48.100992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:48.102322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 365/725] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:48.106982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d777aa-4efa-4ce3-9d38-95701bc8fdaa None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:48.267782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3f7f-ad45-40f5-8134-a29206ca90c3 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.267974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3f7f-ad45-40f5-8134-a29206ca90c3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.268247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3f7f-ad45-40f5-8134-a29206ca90c3 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.273589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 366/726] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:48.274883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4a98-1572-4d44-97ac-476a99a18120 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.275175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4a98-1572-4d44-97ac-476a99a18120 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.275461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4a98-1572-4d44-97ac-476a99a18120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.287424 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d777aa-4efa-4ce3-9d38-95701bc8fdaa None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:48.295323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e19b4a98-1572-4d44-97ac-476a99a18120 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:48.296991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e19b4a98-1572-4d44-97ac-476a99a18120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:48.303086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:48.326723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a8de8-f317-4f60-a759-4306cc4a18be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:48.327779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a8de8-f317-4f60-a759-4306cc4a18be None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.328267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a8de8-f317-4f60-a759-4306cc4a18be None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.328740 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a8de8-f317-4f60-a759-4306cc4a18be None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.329621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a8de8-f317-4f60-a759-4306cc4a18be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:48.330215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a8de8-f317-4f60-a759-4306cc4a18be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:48.332223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a8de8-f317-4f60-a759-4306cc4a18be None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:48.344835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 361/727] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:48.349965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a8de8-f317-4f60-a759-4306cc4a18be None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:48.404145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 367/728] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:48 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:08:48.503787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a8de8-f317-4f60-a759-4306cc4a18be None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:48.542654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02a902-49eb-4b2b-92a7-2d7472af22d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:48.543631 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02a902-49eb-4b2b-92a7-2d7472af22d8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.544113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02a902-49eb-4b2b-92a7-2d7472af22d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.544628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02a902-49eb-4b2b-92a7-2d7472af22d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.556950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02a902-49eb-4b2b-92a7-2d7472af22d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:48.558936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02a902-49eb-4b2b-92a7-2d7472af22d8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-cb02a902-49eb-4b2b-92a7-2d7472af22d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:48.576286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:48.577271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:48.578172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:48.578172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:48.578172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:48.580314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 362/729] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:48.585775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b4a98-1572-4d44-97ac-476a99a18120 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:48.630592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:48.668731 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588f7a-b1db-48c0-bba9-69f8952c4ae9 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.669069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588f7a-b1db-48c0-bba9-69f8952c4ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.669305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67588f7a-b1db-48c0-bba9-69f8952c4ae9 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.670960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 363/730] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:48.677210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e818-6408-418e-ac47-1bdbf9ec5870 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.677498 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e818-6408-418e-ac47-1bdbf9ec5870 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.677792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e818-6408-418e-ac47-1bdbf9ec5870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.704597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4f30e818-6408-418e-ac47-1bdbf9ec5870 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:48.706605 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4f30e818-6408-418e-ac47-1bdbf9ec5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:48.753701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:48.771181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b4a98-1572-4d44-97ac-476a99a18120 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:48.824927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd04ea-537e-44c7-ad25-ce71078237dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:48.825770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd04ea-537e-44c7-ad25-ce71078237dd None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:48.826326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd04ea-537e-44c7-ad25-ce71078237dd None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:48.826881 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd04ea-537e-44c7-ad25-ce71078237dd None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:48.828198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd04ea-537e-44c7-ad25-ce71078237dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:48.828839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd04ea-537e-44c7-ad25-ce71078237dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:48.832439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd04ea-537e-44c7-ad25-ce71078237dd None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:48.846970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 364/731] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:48 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:08:48.848655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30e818-6408-418e-ac47-1bdbf9ec5870 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:48.861759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 368/732] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:48.867651 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd04ea-537e-44c7-ad25-ce71078237dd None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:48.988339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30e818-6408-418e-ac47-1bdbf9ec5870 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:49.026879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbfaca-f2f8-42df-a916-d4bcc332d7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:49.027837 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbfaca-f2f8-42df-a916-d4bcc332d7cf None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.028295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbfaca-f2f8-42df-a916-d4bcc332d7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.028766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbfaca-f2f8-42df-a916-d4bcc332d7cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.040965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbfaca-f2f8-42df-a916-d4bcc332d7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-58fbfaca-f2f8-42df-a916-d4bcc332d7cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:49.046095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:49.046979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:49.047802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:49.050076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 365/733] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:49.057809 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbfaca-f2f8-42df-a916-d4bcc332d7cf None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:49.094101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:49.098143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:49.117519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd04ea-537e-44c7-ad25-ce71078237dd None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:49.208018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbfaca-f2f8-42df-a916-d4bcc332d7cf None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:49.210173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5002b19-9ed7-4e6c-926a-16af1ad2e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:49.211121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5002b19-9ed7-4e6c-926a-16af1ad2e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.211608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5002b19-9ed7-4e6c-926a-16af1ad2e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.212110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5002b19-9ed7-4e6c-926a-16af1ad2e0f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.220757 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5002b19-9ed7-4e6c-926a-16af1ad2e0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:49.222699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5002b19-9ed7-4e6c-926a-16af1ad2e0f3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-f5002b19-9ed7-4e6c-926a-16af1ad2e0f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:49.236899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:49.237950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:49.238855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:49.238855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:49.238855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:49.238855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:49.238855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:49.238855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:49.238855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:49.238855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:49.238855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:49.238855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:49.245910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 369/734] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:49.246499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44541a96-810f-49a3-90f6-17e6938816ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:49.247407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5002b19-9ed7-4e6c-926a-16af1ad2e0f3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:49.247519 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541a96-810f-49a3-90f6-17e6938816ce None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.247772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541a96-810f-49a3-90f6-17e6938816ce None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.248052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541a96-810f-49a3-90f6-17e6938816ce None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.248741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44541a96-810f-49a3-90f6-17e6938816ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:49.249055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44541a96-810f-49a3-90f6-17e6938816ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:49.250461 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44541a96-810f-49a3-90f6-17e6938816ce None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:49.265022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 366/735] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:49.266083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44541a96-810f-49a3-90f6-17e6938816ce None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:49.361927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5002b19-9ed7-4e6c-926a-16af1ad2e0f3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:49.364735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:49.402224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfd61a-f363-4f29-9e1e-12bcd4822150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:49.402862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfd61a-f363-4f29-9e1e-12bcd4822150 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.403152 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfd61a-f363-4f29-9e1e-12bcd4822150 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.403413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfd61a-f363-4f29-9e1e-12bcd4822150 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.404085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfd61a-f363-4f29-9e1e-12bcd4822150 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:49.405478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfd61a-f363-4f29-9e1e-12bcd4822150 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:49.409911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44541a96-810f-49a3-90f6-17e6938816ce None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:49.449794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c49ec0-ef35-48d3-ba9f-6da20c83ce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:49.450408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c49ec0-ef35-48d3-ba9f-6da20c83ce8c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.450693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c49ec0-ef35-48d3-ba9f-6da20c83ce8c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.450964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c49ec0-ef35-48d3-ba9f-6da20c83ce8c None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.451709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c49ec0-ef35-48d3-ba9f-6da20c83ce8c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:49.452016 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c49ec0-ef35-48d3-ba9f-6da20c83ce8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:49.453453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c49ec0-ef35-48d3-ba9f-6da20c83ce8c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:49.479516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 367/736] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 31 19:08:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:49.479516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c49ec0-ef35-48d3-ba9f-6da20c83ce8c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:49.499151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 370/737] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:49 2022] POST /identity/v3/services => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:49.500220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfd61a-f363-4f29-9e1e-12bcd4822150 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:49.539398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:49.630447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c49ec0-ef35-48d3-ba9f-6da20c83ce8c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:49.678800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:49.684953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3485-4e93-4f11-a248-1749b976e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:49.685593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3485-4e93-4f11-a248-1749b976e3dc None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.685922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3485-4e93-4f11-a248-1749b976e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.686346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3485-4e93-4f11-a248-1749b976e3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.697818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd3485-4e93-4f11-a248-1749b976e3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:49.699289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd3485-4e93-4f11-a248-1749b976e3dc None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-4fdd3485-4e93-4f11-a248-1749b976e3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:49.715672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:49.716656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:49.717514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:49.717514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:49.717514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:49.720557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 368/738] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:49.723176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3485-4e93-4f11-a248-1749b976e3dc None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:49.744189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfd61a-f363-4f29-9e1e-12bcd4822150 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:49.791764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c9806-e112-44b6-b8d4-14b03ec2655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:49.792371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c9806-e112-44b6-b8d4-14b03ec2655a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.792686 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c9806-e112-44b6-b8d4-14b03ec2655a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.792916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c9806-e112-44b6-b8d4-14b03ec2655a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.845773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3485-4e93-4f11-a248-1749b976e3dc None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:49.882510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbf8a4-2a30-4e31-8f3b-3ae0a5b8518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:49.883044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbf8a4-2a30-4e31-8f3b-3ae0a5b8518c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.883327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbf8a4-2a30-4e31-8f3b-3ae0a5b8518c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.883603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbf8a4-2a30-4e31-8f3b-3ae0a5b8518c None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.884257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbf8a4-2a30-4e31-8f3b-3ae0a5b8518c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:49.884539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c9806-e112-44b6-b8d4-14b03ec2655a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:49.884646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbf8a4-2a30-4e31-8f3b-3ae0a5b8518c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:49.885965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbf8a4-2a30-4e31-8f3b-3ae0a5b8518c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:49.886568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c9806-e112-44b6-b8d4-14b03ec2655a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:49.900100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:49.904104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 369/739] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:49.905587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ebc2-dd21-4799-a745-960b0ab288ef None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:49.905903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ebc2-dd21-4799-a745-960b0ab288ef None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:49.906185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ebc2-dd21-4799-a745-960b0ab288ef None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:49.907701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 370/740] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:49.911942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389ebc2-dd21-4799-a745-960b0ab288ef None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:49.959874 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.007728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 371/741] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:08:50.009561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498740db-9e2c-4afc-a28a-9254a096bb99 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.010071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498740db-9e2c-4afc-a28a-9254a096bb99 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.010542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498740db-9e2c-4afc-a28a-9254a096bb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.020689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389ebc2-dd21-4799-a745-960b0ab288ef None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.032085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-498740db-9e2c-4afc-a28a-9254a096bb99 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:50.033742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-498740db-9e2c-4afc-a28a-9254a096bb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:50.057360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b54a5a-b754-44d8-8869-e695e1f12526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.057890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b54a5a-b754-44d8-8869-e695e1f12526 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.058248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b54a5a-b754-44d8-8869-e695e1f12526 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.058598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b54a5a-b754-44d8-8869-e695e1f12526 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.067293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b54a5a-b754-44d8-8869-e695e1f12526 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.068884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b54a5a-b754-44d8-8869-e695e1f12526 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-d3b54a5a-b754-44d8-8869-e695e1f12526 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:50.082845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:50.083865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:50.084808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:50.084808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:50.084808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:50.084808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:50.084808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:50.084808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:50.084808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:50.084808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:50.084808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:50.084808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:50.088880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 371/742] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:50.089897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b54a5a-b754-44d8-8869-e695e1f12526 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.116314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 372/743] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:50.117521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498740db-9e2c-4afc-a28a-9254a096bb99 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.165017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.199251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b54a5a-b754-44d8-8869-e695e1f12526 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.201965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.229368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498740db-9e2c-4afc-a28a-9254a096bb99 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.235079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd95a9-7e3b-4fec-b700-16f89ac9a837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.235722 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd95a9-7e3b-4fec-b700-16f89ac9a837 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.236003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd95a9-7e3b-4fec-b700-16f89ac9a837 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.236278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd95a9-7e3b-4fec-b700-16f89ac9a837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.264631 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd95a9-7e3b-4fec-b700-16f89ac9a837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.266507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd95a9-7e3b-4fec-b700-16f89ac9a837 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-88dd95a9-7e3b-4fec-b700-16f89ac9a837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:50.297346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:50.298359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:50.299224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:50.299224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:50.299224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:50.305442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 372/744] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:50.311390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabb7d3-b515-4c1b-8000-67463416d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.312371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabb7d3-b515-4c1b-8000-67463416d274 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.312856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabb7d3-b515-4c1b-8000-67463416d274 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.313326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabb7d3-b515-4c1b-8000-67463416d274 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.314343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabb7d3-b515-4c1b-8000-67463416d274 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:50.314876 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabb7d3-b515-4c1b-8000-67463416d274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.317200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabb7d3-b515-4c1b-8000-67463416d274 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.326701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd95a9-7e3b-4fec-b700-16f89ac9a837 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.366723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 373/745] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:50.372264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabb7d3-b515-4c1b-8000-67463416d274 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.476030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd95a9-7e3b-4fec-b700-16f89ac9a837 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.486618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.491647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabb7d3-b515-4c1b-8000-67463416d274 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.514360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf9e8e-6a72-44bb-8ff7-0540ae6583d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.515068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9e8e-6a72-44bb-8ff7-0540ae6583d6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.515354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9e8e-6a72-44bb-8ff7-0540ae6583d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.515626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9e8e-6a72-44bb-8ff7-0540ae6583d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.516291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf9e8e-6a72-44bb-8ff7-0540ae6583d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:50.516596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf9e8e-6a72-44bb-8ff7-0540ae6583d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.518021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf9e8e-6a72-44bb-8ff7-0540ae6583d6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.529655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafaf48-6c19-4d59-afb8-64567591d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.530308 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafaf48-6c19-4d59-afb8-64567591d484 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.530581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafaf48-6c19-4d59-afb8-64567591d484 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.530850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafaf48-6c19-4d59-afb8-64567591d484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.536040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 373/746] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:50.536040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a1849-9409-42ef-bf44-0e3850f128f5 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.536040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a1849-9409-42ef-bf44-0e3850f128f5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.536040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a1849-9409-42ef-bf44-0e3850f128f5 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.536040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 374/747] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:50.536040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a1849-9409-42ef-bf44-0e3850f128f5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.543558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafaf48-6c19-4d59-afb8-64567591d484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.545548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafaf48-6c19-4d59-afb8-64567591d484 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.557976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-abafaf48-6c19-4d59-afb8-64567591d484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:50.564495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:50.565774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:50.567232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:50.567232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:50.567232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:50.571515 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 374/748] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:50.572190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafaf48-6c19-4d59-afb8-64567591d484 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.649594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a1849-9409-42ef-bf44-0e3850f128f5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.683965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafaf48-6c19-4d59-afb8-64567591d484 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.685722 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8205e86-df4a-46c2-916d-7babb3b4d239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.686454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205e86-df4a-46c2-916d-7babb3b4d239 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.686737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205e86-df4a-46c2-916d-7babb3b4d239 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.687014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205e86-df4a-46c2-916d-7babb3b4d239 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.699468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8205e86-df4a-46c2-916d-7babb3b4d239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-a8205e86-df4a-46c2-916d-7babb3b4d239 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:50.704555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:50.705732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:50.706633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 375/749] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:50.707356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d21f4c-a259-4c23-98c4-19e04a574581 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.707549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d21f4c-a259-4c23-98c4-19e04a574581 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.707830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d21f4c-a259-4c23-98c4-19e04a574581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.734233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-38d21f4c-a259-4c23-98c4-19e04a574581 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:50.735373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-38d21f4c-a259-4c23-98c4-19e04a574581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:50.748353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beec915-7237-4413-b851-70cb271d9e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.749960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec915-7237-4413-b851-70cb271d9e82 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.750455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec915-7237-4413-b851-70cb271d9e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.750947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec915-7237-4413-b851-70cb271d9e82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.763300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beec915-7237-4413-b851-70cb271d9e82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.766455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beec915-7237-4413-b851-70cb271d9e82 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-7beec915-7237-4413-b851-70cb271d9e82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:50.789909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:50.790856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:50.791719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:50.791719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:50.791719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:50.791719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:50.791719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:50.791719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:50.791719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:50.791719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:50.791719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 375/750] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:50.792622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beec915-7237-4413-b851-70cb271d9e82 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.809328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.841885 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 376/751] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:50.842843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d21f4c-a259-4c23-98c4-19e04a574581 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:50.852803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:50.939240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beec915-7237-4413-b851-70cb271d9e82 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.953275 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d21f4c-a259-4c23-98c4-19e04a574581 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:50.986428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefef99-df32-42c4-af2e-4e3f5247c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.988154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefef99-df32-42c4-af2e-4e3f5247c802 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.988509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefef99-df32-42c4-af2e-4e3f5247c802 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.988850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefef99-df32-42c4-af2e-4e3f5247c802 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.989953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefef99-df32-42c4-af2e-4e3f5247c802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:50.990349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefef99-df32-42c4-af2e-4e3f5247c802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.991795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefef99-df32-42c4-af2e-4e3f5247c802 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:50.993931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba367e3-5fa8-4bc1-b242-a1abdc0a5a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:50.994768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba367e3-5fa8-4bc1-b242-a1abdc0a5a30 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:50.995150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba367e3-5fa8-4bc1-b242-a1abdc0a5a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:50.995434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba367e3-5fa8-4bc1-b242-a1abdc0a5a30 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:50.996122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba367e3-5fa8-4bc1-b242-a1abdc0a5a30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:50.996430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba367e3-5fa8-4bc1-b242-a1abdc0a5a30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:50.997896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba367e3-5fa8-4bc1-b242-a1abdc0a5a30 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.012354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 377/752] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:51.013206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba367e3-5fa8-4bc1-b242-a1abdc0a5a30 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.015803 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 376/753] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:51.019299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefef99-df32-42c4-af2e-4e3f5247c802 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.109350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.120512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.151964 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefef99-df32-42c4-af2e-4e3f5247c802 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.164446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba367e3-5fa8-4bc1-b242-a1abdc0a5a30 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.191555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3ad3d-711e-4d14-acc1-63b973a425d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.192677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ad3d-711e-4d14-acc1-63b973a425d1 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.193446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ad3d-711e-4d14-acc1-63b973a425d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.194241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ad3d-711e-4d14-acc1-63b973a425d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.204165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2f21a-8995-48aa-8421-2836e81defec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.204780 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f21a-8995-48aa-8421-2836e81defec None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.205065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f21a-8995-48aa-8421-2836e81defec None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.205338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2f21a-8995-48aa-8421-2836e81defec None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.206070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2f21a-8995-48aa-8421-2836e81defec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:51.206910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2f21a-8995-48aa-8421-2836e81defec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.208355 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2f21a-8995-48aa-8421-2836e81defec None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.209765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3ad3d-711e-4d14-acc1-63b973a425d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.212081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3ad3d-711e-4d14-acc1-63b973a425d1 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.221440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 378/754] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:51.222714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2f21a-8995-48aa-8421-2836e81defec None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-51a3ad3d-711e-4d14-acc1-63b973a425d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:51.235179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:51.236174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:51.237090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:51.237090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:51.237090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:51.237090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 377/755] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:51.237090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3ad3d-711e-4d14-acc1-63b973a425d1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.334890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2f21a-8995-48aa-8421-2836e81defec None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.361501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3ad3d-711e-4d14-acc1-63b973a425d1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.364756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.372618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38e020-a65a-4f93-a108-80006e11eef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.373327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e020-a65a-4f93-a108-80006e11eef0 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.373576 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e020-a65a-4f93-a108-80006e11eef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.374024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e020-a65a-4f93-a108-80006e11eef0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.381033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38e020-a65a-4f93-a108-80006e11eef0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.382527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38e020-a65a-4f93-a108-80006e11eef0 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.390742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-5f38e020-a65a-4f93-a108-80006e11eef0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:51.394748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:51.395691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:51.396555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:51.396555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:51.396555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:51.396555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:51.396555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:51.396555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:51.396555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:51.396555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:51.396555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 379/756] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:51.397095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38e020-a65a-4f93-a108-80006e11eef0 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.408397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f0fdd-25ee-40a6-84b6-6e44c53fabe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.409036 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f0fdd-25ee-40a6-84b6-6e44c53fabe1 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.409319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f0fdd-25ee-40a6-84b6-6e44c53fabe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.410299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f0fdd-25ee-40a6-84b6-6e44c53fabe1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.410829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f0fdd-25ee-40a6-84b6-6e44c53fabe1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.412197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f0fdd-25ee-40a6-84b6-6e44c53fabe1 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-cc3f0fdd-25ee-40a6-84b6-6e44c53fabe1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:51.421551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:51.422571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:51.423392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 378/757] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:51.424271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f0fdd-25ee-40a6-84b6-6e44c53fabe1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.511077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38e020-a65a-4f93-a108-80006e11eef0 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.538362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f0fdd-25ee-40a6-84b6-6e44c53fabe1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.557276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce2f6-42b6-4684-aa7c-9baf9be399f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.557920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce2f6-42b6-4684-aa7c-9baf9be399f9 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.558201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce2f6-42b6-4684-aa7c-9baf9be399f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.558473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce2f6-42b6-4684-aa7c-9baf9be399f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.559296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ce2f6-42b6-4684-aa7c-9baf9be399f9 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=78c331b659da48549c4c91e659ff83ba) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:51.559603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ce2f6-42b6-4684-aa7c-9baf9be399f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.561023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ce2f6-42b6-4684-aa7c-9baf9be399f9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.567983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 380/758] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/role_assignments?user.id=78c331b659da48549c4c91e659ff83ba&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:51.568643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce2f6-42b6-4684-aa7c-9baf9be399f9 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.595310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727a149-1669-46b1-9e98-4b8c8c6e7469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.596418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727a149-1669-46b1-9e98-4b8c8c6e7469 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.596957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727a149-1669-46b1-9e98-4b8c8c6e7469 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.597481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727a149-1669-46b1-9e98-4b8c8c6e7469 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.599197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727a149-1669-46b1-9e98-4b8c8c6e7469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:51.599838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727a149-1669-46b1-9e98-4b8c8c6e7469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.602291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727a149-1669-46b1-9e98-4b8c8c6e7469 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.621045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 379/759] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:51.623057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727a149-1669-46b1-9e98-4b8c8c6e7469 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.639493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.693217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.700024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce2f6-42b6-4684-aa7c-9baf9be399f9 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.748237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b4120-8016-4d05-a70a-08323470c5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.748858 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b4120-8016-4d05-a70a-08323470c5aa None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.749147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b4120-8016-4d05-a70a-08323470c5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.749425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b4120-8016-4d05-a70a-08323470c5aa None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.750150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b4120-8016-4d05-a70a-08323470c5aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:51.750463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b4120-8016-4d05-a70a-08323470c5aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.751932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b4120-8016-4d05-a70a-08323470c5aa None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.754250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727a149-1669-46b1-9e98-4b8c8c6e7469 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.765011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 381/760] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:51.765812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b4120-8016-4d05-a70a-08323470c5aa None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.800882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1674-544a-4b8f-b679-958d98518245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.801980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1674-544a-4b8f-b679-958d98518245 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.802270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1674-544a-4b8f-b679-958d98518245 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.802824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1674-544a-4b8f-b679-958d98518245 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.803472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c1674-544a-4b8f-b679-958d98518245 None admin] RBAC: Adding query filter params (name=network) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:51.803788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c1674-544a-4b8f-b679-958d98518245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.806258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c1674-544a-4b8f-b679-958d98518245 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.814313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 380/761] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:51.815185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42095c3-fbd0-43db-8320-a63193ca30d0 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.815468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42095c3-fbd0-43db-8320-a63193ca30d0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.816310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42095c3-fbd0-43db-8320-a63193ca30d0 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.819397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 381/762] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:51.822710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42095c3-fbd0-43db-8320-a63193ca30d0 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:51.907834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b4120-8016-4d05-a70a-08323470c5aa None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.923690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.950110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e02a2-f350-46c9-aa35-3f52aee8f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:51.950761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e02a2-f350-46c9-aa35-3f52aee8f3cb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:51.951076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e02a2-f350-46c9-aa35-3f52aee8f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:51.951313 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e02a2-f350-46c9-aa35-3f52aee8f3cb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:51.952233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42095c3-fbd0-43db-8320-a63193ca30d0 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:51.959318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e02a2-f350-46c9-aa35-3f52aee8f3cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:51.960795 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e02a2-f350-46c9-aa35-3f52aee8f3cb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:51.964795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-d38e02a2-f350-46c9-aa35-3f52aee8f3cb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:51.975844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:51.977048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:51.978214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:51.978214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:51.978214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:51.978214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:51.978214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:51.978214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:51.978214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:51.978214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:51.978214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:51.978214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:51.980554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 382/763] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:51.981746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e02a2-f350-46c9-aa35-3f52aee8f3cb None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:52.001478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b14bb2-0139-4b9f-a993-f0f4273879e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:52.002312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14bb2-0139-4b9f-a993-f0f4273879e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:52.002662 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14bb2-0139-4b9f-a993-f0f4273879e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:52.003006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14bb2-0139-4b9f-a993-f0f4273879e7 None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/799cbde43a3643a4beef892d23145112/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:52.006652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b14bb2-0139-4b9f-a993-f0f4273879e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=799cbde43a3643a4beef892d23145112, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:52.008401 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b14bb2-0139-4b9f-a993-f0f4273879e7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:52.077905 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 382/764] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:51 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/799cbde43a3643a4beef892d23145112/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:52.079503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af05325-7923-413c-9265-0ce66f0552de None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:52.079879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af05325-7923-413c-9265-0ce66f0552de None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:52.080229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af05325-7923-413c-9265-0ce66f0552de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:52.101056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-3af05325-7923-413c-9265-0ce66f0552de None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:52.102607 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3af05325-7923-413c-9265-0ce66f0552de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:52.114175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e02a2-f350-46c9-aa35-3f52aee8f3cb None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:52.169907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77256c74-c730-41fd-9f45-ed12a13621d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:52.170703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77256c74-c730-41fd-9f45-ed12a13621d3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:52.171081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77256c74-c730-41fd-9f45-ed12a13621d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:52.171861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77256c74-c730-41fd-9f45-ed12a13621d3 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:52.172218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77256c74-c730-41fd-9f45-ed12a13621d3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:52.172600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77256c74-c730-41fd-9f45-ed12a13621d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:52.174312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77256c74-c730-41fd-9f45-ed12a13621d3 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:52.181715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 383/765] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:52.182860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77256c74-c730-41fd-9f45-ed12a13621d3 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:52.197301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 383/766] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:52.198631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af05325-7923-413c-9265-0ce66f0552de None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:52.247165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:52.324415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:52.329761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af05325-7923-413c-9265-0ce66f0552de None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:52.345726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77256c74-c730-41fd-9f45-ed12a13621d3 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:52.377607 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f7d0f-1251-4647-93db-59262289914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:52.378408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f7d0f-1251-4647-93db-59262289914d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:52.378726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f7d0f-1251-4647-93db-59262289914d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:52.379114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f7d0f-1251-4647-93db-59262289914d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:52.379987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f7d0f-1251-4647-93db-59262289914d None admin] RBAC: Adding query filter params (interface=public, service_id=1623b47dd1ea4e81b21e0527b81bfd2f, region_id=RegionOne) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:52.380428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f7d0f-1251-4647-93db-59262289914d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:52.381925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f7d0f-1251-4647-93db-59262289914d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:52.389778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abeaff-5f0e-4c9b-8141-da03faefa662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:52.390595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 384/767] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 31 19:08:52 2022] GET /identity/v3/endpoints?service_id=1623b47dd1ea4e81b21e0527b81bfd2f&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:52.390897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abeaff-5f0e-4c9b-8141-da03faefa662 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:52.391346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abeaff-5f0e-4c9b-8141-da03faefa662 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:52.391790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abeaff-5f0e-4c9b-8141-da03faefa662 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:52.392699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abeaff-5f0e-4c9b-8141-da03faefa662 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:52.393175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abeaff-5f0e-4c9b-8141-da03faefa662 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:52.394817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abeaff-5f0e-4c9b-8141-da03faefa662 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:52.396027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f7d0f-1251-4647-93db-59262289914d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:52.416662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 384/768] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 31 19:08:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:52.422906 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abeaff-5f0e-4c9b-8141-da03faefa662 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:52.528857 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f7d0f-1251-4647-93db-59262289914d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:52.570102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65b1d0-387a-4832-b8c9-69baed2cc027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:52.571362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65b1d0-387a-4832-b8c9-69baed2cc027 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:52.571707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65b1d0-387a-4832-b8c9-69baed2cc027 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:52.572047 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65b1d0-387a-4832-b8c9-69baed2cc027 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:52.573015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65b1d0-387a-4832-b8c9-69baed2cc027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:52.574824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65b1d0-387a-4832-b8c9-69baed2cc027 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:52.582298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 385/769] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:52 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:52.588497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65b1d0-387a-4832-b8c9-69baed2cc027 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:52.590135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:52.602691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abeaff-5f0e-4c9b-8141-da03faefa662 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:52.658067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:52.687300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49abb0-084e-444e-85b6-256f39ffc963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:52.688000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49abb0-084e-444e-85b6-256f39ffc963 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:52.688288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49abb0-084e-444e-85b6-256f39ffc963 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:52.688642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49abb0-084e-444e-85b6-256f39ffc963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:52.785349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65b1d0-387a-4832-b8c9-69baed2cc027 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:52.814181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49abb0-084e-444e-85b6-256f39ffc963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:52.814711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49abb0-084e-444e-85b6-256f39ffc963 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:52.833096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab802-4373-414d-9cdc-691d5baa5209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:52.833821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab802-4373-414d-9cdc-691d5baa5209 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:52.834120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab802-4373-414d-9cdc-691d5baa5209 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:52.834403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab802-4373-414d-9cdc-691d5baa5209 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:52.835133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faab802-4373-414d-9cdc-691d5baa5209 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:52.836762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faab802-4373-414d-9cdc-691d5baa5209 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-7faab802-4373-414d-9cdc-691d5baa5209 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:52.849002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:52.850120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:52.850949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:52.855492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 386/770] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 31 19:08:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:52.856986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab802-4373-414d-9cdc-691d5baa5209 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:52.936600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:52.945837 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 385/771] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:08:52.951901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49abb0-084e-444e-85b6-256f39ffc963 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:52.972838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:52.983686 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab802-4373-414d-9cdc-691d5baa5209 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:53.026029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745a262-45f6-4d05-91a8-4ca7bb29ef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:53.026665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745a262-45f6-4d05-91a8-4ca7bb29ef59 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.027041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745a262-45f6-4d05-91a8-4ca7bb29ef59 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.027575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745a262-45f6-4d05-91a8-4ca7bb29ef59 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.028029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745a262-45f6-4d05-91a8-4ca7bb29ef59 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:53.028338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745a262-45f6-4d05-91a8-4ca7bb29ef59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:53.029891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745a262-45f6-4d05-91a8-4ca7bb29ef59 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:53.040298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 387/772] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:53.041708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745a262-45f6-4d05-91a8-4ca7bb29ef59 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:53.089481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49abb0-084e-444e-85b6-256f39ffc963 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:53.161635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745a262-45f6-4d05-91a8-4ca7bb29ef59 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:53.204142 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c307-e23a-4314-8d77-293d71df70ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:53.204855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c307-e23a-4314-8d77-293d71df70ff None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.205146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c307-e23a-4314-8d77-293d71df70ff None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.205424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c307-e23a-4314-8d77-293d71df70ff None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.206119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043c307-e23a-4314-8d77-293d71df70ff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:53.207007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043c307-e23a-4314-8d77-293d71df70ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:53.208475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043c307-e23a-4314-8d77-293d71df70ff None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:53.221097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 388/773] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:53.222709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c307-e23a-4314-8d77-293d71df70ff None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:53.250834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:53.260395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256738e4-d836-49c4-b3d4-18ee6ffc7435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:53.268737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256738e4-d836-49c4-b3d4-18ee6ffc7435 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.268737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256738e4-d836-49c4-b3d4-18ee6ffc7435 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.268737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256738e4-d836-49c4-b3d4-18ee6ffc7435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.292962 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256738e4-d836-49c4-b3d4-18ee6ffc7435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:53.294895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256738e4-d836-49c4-b3d4-18ee6ffc7435 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-256738e4-d836-49c4-b3d4-18ee6ffc7435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:53.323643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:53.324662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:53.325578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:53.325578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:53.325578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:53.330901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 386/774] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:53.338632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256738e4-d836-49c4-b3d4-18ee6ffc7435 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:53.408627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c307-e23a-4314-8d77-293d71df70ff None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:53.424588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:53.452519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee55f28-a8af-400d-bd67-6382cea83953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:53.453741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee55f28-a8af-400d-bd67-6382cea83953 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.454388 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee55f28-a8af-400d-bd67-6382cea83953 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.454873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee55f28-a8af-400d-bd67-6382cea83953 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.456396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee55f28-a8af-400d-bd67-6382cea83953 None admin] RBAC: Adding query filter params (interface=public, service_id=07cd16a57e0645dd8573b78f909b7a6a, region_id=RegionOne) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:53.457065 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee55f28-a8af-400d-bd67-6382cea83953 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:53.459624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee55f28-a8af-400d-bd67-6382cea83953 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:53.470778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 389/775] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 31 19:08:53 2022] GET /identity/v3/endpoints?service_id=07cd16a57e0645dd8573b78f909b7a6a&interface=public®ion_id=RegionOne => generated 194 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:53.472962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee55f28-a8af-400d-bd67-6382cea83953 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:53.546708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256738e4-d836-49c4-b3d4-18ee6ffc7435 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:53.617489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f56d3b-e533-4e23-98f0-a3eb444611e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:53.618274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56d3b-e533-4e23-98f0-a3eb444611e6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.618483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56d3b-e533-4e23-98f0-a3eb444611e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.618750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56d3b-e533-4e23-98f0-a3eb444611e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.619610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:53.619992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f56d3b-e533-4e23-98f0-a3eb444611e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:53.621223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f56d3b-e533-4e23-98f0-a3eb444611e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:53.622750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f56d3b-e533-4e23-98f0-a3eb444611e6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:53.635524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee55f28-a8af-400d-bd67-6382cea83953 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:53.636091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 387/776] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:53.637770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe97c9f-d96a-4a61-b62f-d347bd489030 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.639034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe97c9f-d96a-4a61-b62f-d347bd489030 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.639467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe97c9f-d96a-4a61-b62f-d347bd489030 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.641396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 388/777] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:53.642311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe97c9f-d96a-4a61-b62f-d347bd489030 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:53.685932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767aa3f-da4c-484d-a0f3-de42518bb18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:53.686852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767aa3f-da4c-484d-a0f3-de42518bb18b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.687274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767aa3f-da4c-484d-a0f3-de42518bb18b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.687688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767aa3f-da4c-484d-a0f3-de42518bb18b None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.688461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767aa3f-da4c-484d-a0f3-de42518bb18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:53.690008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767aa3f-da4c-484d-a0f3-de42518bb18b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:53.697055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 390/778] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:53 2022] GET /identity/v3/services => generated 772 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:53.698608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47421b41-453b-4ee5-8af8-9d3bd8570fcb None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.699037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47421b41-453b-4ee5-8af8-9d3bd8570fcb None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.699573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47421b41-453b-4ee5-8af8-9d3bd8570fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.719763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-47421b41-453b-4ee5-8af8-9d3bd8570fcb None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:53.721320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-47421b41-453b-4ee5-8af8-9d3bd8570fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:53.769701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe97c9f-d96a-4a61-b62f-d347bd489030 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:53.778837 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:53.822143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 391/779] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:53.830154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079356-1d7e-44b7-bcfd-172e8d4a450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:53.831237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079356-1d7e-44b7-bcfd-172e8d4a450b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:53.832319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079356-1d7e-44b7-bcfd-172e8d4a450b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:53.833000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079356-1d7e-44b7-bcfd-172e8d4a450b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:53.842481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96079356-1d7e-44b7-bcfd-172e8d4a450b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:53.844379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96079356-1d7e-44b7-bcfd-172e8d4a450b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-96079356-1d7e-44b7-bcfd-172e8d4a450b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:53.857128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:53.858353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:53.859296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:53.859296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:53.859296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:53.859296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:53.859296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:53.859296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:53.859296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:53.859296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:53.861542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 389/780] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:53.869712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47421b41-453b-4ee5-8af8-9d3bd8570fcb None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:53.990230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:54.013661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47421b41-453b-4ee5-8af8-9d3bd8570fcb None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:54.052687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e4ad6-5869-47b1-a0da-9c167c774fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:54.053371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e4ad6-5869-47b1-a0da-9c167c774fea None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.053681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e4ad6-5869-47b1-a0da-9c167c774fea None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.053962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e4ad6-5869-47b1-a0da-9c167c774fea None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.054771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e4ad6-5869-47b1-a0da-9c167c774fea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:54.055176 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e4ad6-5869-47b1-a0da-9c167c774fea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:54.056633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e4ad6-5869-47b1-a0da-9c167c774fea None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:54.070809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 392/781] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:54.076458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079356-1d7e-44b7-bcfd-172e8d4a450b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:54.160687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e4ad6-5869-47b1-a0da-9c167c774fea None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:54.229836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079356-1d7e-44b7-bcfd-172e8d4a450b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:54.268439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8a6bc-d280-4eac-9794-a08204ff600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:54.269012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8a6bc-d280-4eac-9794-a08204ff600b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.269293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8a6bc-d280-4eac-9794-a08204ff600b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.269564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8a6bc-d280-4eac-9794-a08204ff600b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.270498 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8a6bc-d280-4eac-9794-a08204ff600b None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=de4d78d267af4fe0a6aefed603b0343f) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:54.270824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8a6bc-d280-4eac-9794-a08204ff600b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:54.275185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8a6bc-d280-4eac-9794-a08204ff600b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:54.278738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 390/782] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:54 2022] GET /identity/v3/role_assignments?user.id=de4d78d267af4fe0a6aefed603b0343f&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:54.382919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e4ad6-5869-47b1-a0da-9c167c774fea None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:54.440833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64157f82-3451-4b0c-a03d-c400b4cc2f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:54.441503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64157f82-3451-4b0c-a03d-c400b4cc2f8f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.441796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64157f82-3451-4b0c-a03d-c400b4cc2f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.442073 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64157f82-3451-4b0c-a03d-c400b4cc2f8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.454245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:54.459463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64157f82-3451-4b0c-a03d-c400b4cc2f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-64157f82-3451-4b0c-a03d-c400b4cc2f8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:54.464367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:54.471061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:54.473688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 393/783] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:54.477833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8a6bc-d280-4eac-9794-a08204ff600b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:54.517158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:54.560133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b5ee-d151-4def-8fe5-c00c046848e7 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.560307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b5ee-d151-4def-8fe5-c00c046848e7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.560591 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b5ee-d151-4def-8fe5-c00c046848e7 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.561976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 394/784] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:54.567592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229874ca-2550-46bf-9b79-136657a6437f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.567867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229874ca-2550-46bf-9b79-136657a6437f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.568466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229874ca-2550-46bf-9b79-136657a6437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.605074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-229874ca-2550-46bf-9b79-136657a6437f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:54.606328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-229874ca-2550-46bf-9b79-136657a6437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:54.639397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8a6bc-d280-4eac-9794-a08204ff600b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:54.711889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b400e2d-b538-4862-b677-dec6ae6273a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:54.712919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b400e2d-b538-4862-b677-dec6ae6273a8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.713406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b400e2d-b538-4862-b677-dec6ae6273a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.713914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b400e2d-b538-4862-b677-dec6ae6273a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.714826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b400e2d-b538-4862-b677-dec6ae6273a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:54.715337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b400e2d-b538-4862-b677-dec6ae6273a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:54.716904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b400e2d-b538-4862-b677-dec6ae6273a8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:54.733429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 395/785] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:54.735905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 391/786] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:54.742129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229874ca-2550-46bf-9b79-136657a6437f None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:54.849067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229874ca-2550-46bf-9b79-136657a6437f None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:54.879026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:54.887336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71143b6-f516-4b14-b139-5de590a6d56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:54.887982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71143b6-f516-4b14-b139-5de590a6d56a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:54.888270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71143b6-f516-4b14-b139-5de590a6d56a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:54.888609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71143b6-f516-4b14-b139-5de590a6d56a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:54.900067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71143b6-f516-4b14-b139-5de590a6d56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:54.901533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71143b6-f516-4b14-b139-5de590a6d56a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-f71143b6-f516-4b14-b139-5de590a6d56a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:54.917317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:54.918331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:54.919197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:54.919197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:54.919197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:54.919197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 396/787] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:54.924778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b400e2d-b538-4862-b677-dec6ae6273a8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:55.066154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:55.078509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b400e2d-b538-4862-b677-dec6ae6273a8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:55.103590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71143b6-f516-4b14-b139-5de590a6d56a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:55.122189 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8539c7-260f-41e4-9207-05d69ef1b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:55.123213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8539c7-260f-41e4-9207-05d69ef1b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:55.123696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8539c7-260f-41e4-9207-05d69ef1b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:55.124194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8539c7-260f-41e4-9207-05d69ef1b7d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:55.125052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8539c7-260f-41e4-9207-05d69ef1b7d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:55.125558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8539c7-260f-41e4-9207-05d69ef1b7d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:55.127237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8539c7-260f-41e4-9207-05d69ef1b7d5 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:55.142022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 392/788] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:55.150953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8539c7-260f-41e4-9207-05d69ef1b7d5 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:55.319877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8539c7-260f-41e4-9207-05d69ef1b7d5 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:55.320075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71143b6-f516-4b14-b139-5de590a6d56a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:55.365565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c265dc-7ead-4942-8e36-cf58d5c3fb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:55.366152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c265dc-7ead-4942-8e36-cf58d5c3fb4a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:55.366430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c265dc-7ead-4942-8e36-cf58d5c3fb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:55.366699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c265dc-7ead-4942-8e36-cf58d5c3fb4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:55.377314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c265dc-7ead-4942-8e36-cf58d5c3fb4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:55.378840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c265dc-7ead-4942-8e36-cf58d5c3fb4a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:55.396927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ed7a1-5ecb-40af-9614-05fa1d405e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:55.397569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed7a1-5ecb-40af-9614-05fa1d405e45 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:55.397869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed7a1-5ecb-40af-9614-05fa1d405e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:55.398141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed7a1-5ecb-40af-9614-05fa1d405e45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-97c265dc-7ead-4942-8e36-cf58d5c3fb4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:55.404742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:55.405701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:55.406664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:55.406664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:55.406664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:55.406664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:55.406664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:55.406664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:55.406664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:55.406664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:55.406664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:08:55.406664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:55.409744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 393/789] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:55.410970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d475f0-5e04-4955-93c9-40f9881973ab None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:55.411252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d475f0-5e04-4955-93c9-40f9881973ab None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:55.411524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d475f0-5e04-4955-93c9-40f9881973ab None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:55.412782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 394/790] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:55.417852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d475f0-5e04-4955-93c9-40f9881973ab None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:55.426013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ed7a1-5ecb-40af-9614-05fa1d405e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-cb4ed7a1-5ecb-40af-9614-05fa1d405e45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:55.432501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:55.433430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:55.434285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 397/791] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:55.435437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7674b5-7d10-47ff-890b-1a0a80f49dcb None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:55.435437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7674b5-7d10-47ff-890b-1a0a80f49dcb None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:55.435745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7674b5-7d10-47ff-890b-1a0a80f49dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:55.454867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-3e7674b5-7d10-47ff-890b-1a0a80f49dcb None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:55.456137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3e7674b5-7d10-47ff-890b-1a0a80f49dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:55.458005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:55.495633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:55.535749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 398/792] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:55.536715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7674b5-7d10-47ff-890b-1a0a80f49dcb None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:55.544975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d475f0-5e04-4955-93c9-40f9881973ab None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:55.585402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da9bc-9eab-42ee-aacc-f630abf6f394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:55.586690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da9bc-9eab-42ee-aacc-f630abf6f394 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:55.587357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da9bc-9eab-42ee-aacc-f630abf6f394 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:55.588042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da9bc-9eab-42ee-aacc-f630abf6f394 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:55.589022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82da9bc-9eab-42ee-aacc-f630abf6f394 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:55.589534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82da9bc-9eab-42ee-aacc-f630abf6f394 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:55.591231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82da9bc-9eab-42ee-aacc-f630abf6f394 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:55.612127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 395/793] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 31 19:08:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:55.620587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da9bc-9eab-42ee-aacc-f630abf6f394 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:55.742582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:55.782223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da9bc-9eab-42ee-aacc-f630abf6f394 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:55.809890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7674b5-7d10-47ff-890b-1a0a80f49dcb None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:55.843753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3be17-9aa2-46f0-b620-11324338257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:55.844788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3be17-9aa2-46f0-b620-11324338257a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:55.845318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3be17-9aa2-46f0-b620-11324338257a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:55.845861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3be17-9aa2-46f0-b620-11324338257a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:55.865573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3be17-9aa2-46f0-b620-11324338257a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:55.867068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3be17-9aa2-46f0-b620-11324338257a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:55.890782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ebb8-d5bf-4365-a9e6-c1049d86ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:55.891383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ebb8-d5bf-4365-a9e6-c1049d86ec17 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:55.891618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ebb8-d5bf-4365-a9e6-c1049d86ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:55.891860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ebb8-d5bf-4365-a9e6-c1049d86ec17 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:55.892545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9ebb8-d5bf-4365-a9e6-c1049d86ec17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:55.892851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9ebb8-d5bf-4365-a9e6-c1049d86ec17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:55.894302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9ebb8-d5bf-4365-a9e6-c1049d86ec17 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-43f3be17-9aa2-46f0-b620-11324338257a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:55.894701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:55.895754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:55.896645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:55.896645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:55.896645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:55.899674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 396/794] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:55.900734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3be17-9aa2-46f0-b620-11324338257a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:55.910428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 399/795] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:55.911147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ebb8-d5bf-4365-a9e6-c1049d86ec17 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:55.947884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:56.029405 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ebb8-d5bf-4365-a9e6-c1049d86ec17 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.040387 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3be17-9aa2-46f0-b620-11324338257a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.071132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:56.086938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7991c8b-0707-4cee-800a-957dc2959500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.087964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7991c8b-0707-4cee-800a-957dc2959500 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.088512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7991c8b-0707-4cee-800a-957dc2959500 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.089002 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7991c8b-0707-4cee-800a-957dc2959500 None admin] PATH_INFO: `/v3/services/network` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.089887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7991c8b-0707-4cee-800a-957dc2959500 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.091464 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7991c8b-0707-4cee-800a-957dc2959500 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.092951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e601c1-882b-44ab-99f4-28029e792294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.094046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e601c1-882b-44ab-99f4-28029e792294 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.094562 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e601c1-882b-44ab-99f4-28029e792294 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.095072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e601c1-882b-44ab-99f4-28029e792294 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.096295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e601c1-882b-44ab-99f4-28029e792294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:56.097379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e601c1-882b-44ab-99f4-28029e792294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.100092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e601c1-882b-44ab-99f4-28029e792294 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-a7991c8b-0707-4cee-800a-957dc2959500 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:56.107647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:56.108673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:08:56.109544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:56.117097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 397/796] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:55 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:56.117097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7991c8b-0707-4cee-800a-957dc2959500 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.120981 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 400/797] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:56.122336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e601c1-882b-44ab-99f4-28029e792294 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.228403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:56.239182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e601c1-882b-44ab-99f4-28029e792294 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.255119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7991c8b-0707-4cee-800a-957dc2959500 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.285553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae9382-13d6-4c4b-9a77-b5ba5702238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.286620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae9382-13d6-4c4b-9a77-b5ba5702238f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.287182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae9382-13d6-4c4b-9a77-b5ba5702238f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.287465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae9382-13d6-4c4b-9a77-b5ba5702238f None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.288121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae9382-13d6-4c4b-9a77-b5ba5702238f None admin] RBAC: Adding query filter params (name=network) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:56.288428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae9382-13d6-4c4b-9a77-b5ba5702238f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.289865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae9382-13d6-4c4b-9a77-b5ba5702238f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.290757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50ffc0-5a13-47f9-a226-364bf3982dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.291392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ffc0-5a13-47f9-a226-364bf3982dab None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.291670 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ffc0-5a13-47f9-a226-364bf3982dab None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.291953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50ffc0-5a13-47f9-a226-364bf3982dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.296087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 401/798] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:56.297216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae9382-13d6-4c4b-9a77-b5ba5702238f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.303335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50ffc0-5a13-47f9-a226-364bf3982dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.304801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50ffc0-5a13-47f9-a226-364bf3982dab None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-6d50ffc0-5a13-47f9-a226-364bf3982dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:56.324723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:56.325949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:56.326915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:56.326915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:56.326915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:56.326915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 398/799] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:56.327604 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98dbe2-29c1-4d7c-a584-54859b160a1c None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.327897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98dbe2-29c1-4d7c-a584-54859b160a1c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.328179 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98dbe2-29c1-4d7c-a584-54859b160a1c None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.329554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 399/800] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:56.334476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98dbe2-29c1-4d7c-a584-54859b160a1c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.381600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:56.426080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae9382-13d6-4c4b-9a77-b5ba5702238f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.448131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98dbe2-29c1-4d7c-a584-54859b160a1c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.475279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9973891-e4af-4501-a81f-bf8e96e685d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.475909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9973891-e4af-4501-a81f-bf8e96e685d8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.476193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9973891-e4af-4501-a81f-bf8e96e685d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.476470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9973891-e4af-4501-a81f-bf8e96e685d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.483798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9973891-e4af-4501-a81f-bf8e96e685d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.485200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9973891-e4af-4501-a81f-bf8e96e685d8 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.487489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab980ecd-f07e-43fc-8243-7fb042c28fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.488105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980ecd-f07e-43fc-8243-7fb042c28fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.488396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980ecd-f07e-43fc-8243-7fb042c28fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.488675 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab980ecd-f07e-43fc-8243-7fb042c28fa6 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.489314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab980ecd-f07e-43fc-8243-7fb042c28fa6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:56.489621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab980ecd-f07e-43fc-8243-7fb042c28fa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.491016 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab980ecd-f07e-43fc-8243-7fb042c28fa6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.501627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 400/801] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:08:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:56.501627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab980ecd-f07e-43fc-8243-7fb042c28fa6 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b9973891-e4af-4501-a81f-bf8e96e685d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:56.501917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:56.502694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 402/802] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46a19-174c-43e1-bf14-22f0974e4e88 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.503558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46a19-174c-43e1-bf14-22f0974e4e88 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.504130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46a19-174c-43e1-bf14-22f0974e4e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.521253 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-fde46a19-174c-43e1-bf14-22f0974e4e88 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:56.522499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fde46a19-174c-43e1-bf14-22f0974e4e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:56.536147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:56.607431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 403/803] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:56.608262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde46a19-174c-43e1-bf14-22f0974e4e88 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.617187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab980ecd-f07e-43fc-8243-7fb042c28fa6 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.619016 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:56.674162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ef8f-b6de-4073-a9d9-7db088f486ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.675147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ef8f-b6de-4073-a9d9-7db088f486ca None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.675760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ef8f-b6de-4073-a9d9-7db088f486ca None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.676218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ef8f-b6de-4073-a9d9-7db088f486ca None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.677340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8ef8f-b6de-4073-a9d9-7db088f486ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:56.677877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8ef8f-b6de-4073-a9d9-7db088f486ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.680034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8ef8f-b6de-4073-a9d9-7db088f486ca None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.703186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 401/804] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:56.703186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ef8f-b6de-4073-a9d9-7db088f486ca None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.751661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde46a19-174c-43e1-bf14-22f0974e4e88 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.789292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd61720-fa44-4a99-b1e4-e587b84c5bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.790017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd61720-fa44-4a99-b1e4-e587b84c5bc7 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.790369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd61720-fa44-4a99-b1e4-e587b84c5bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.790790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd61720-fa44-4a99-b1e4-e587b84c5bc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.791519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd61720-fa44-4a99-b1e4-e587b84c5bc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.792890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd61720-fa44-4a99-b1e4-e587b84c5bc7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.820968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ef8f-b6de-4073-a9d9-7db088f486ca None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:56.854427 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159787f4-15e1-412e-a203-c63219c5831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:56.855023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159787f4-15e1-412e-a203-c63219c5831b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.855308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159787f4-15e1-412e-a203-c63219c5831b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.855572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159787f4-15e1-412e-a203-c63219c5831b None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.856260 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159787f4-15e1-412e-a203-c63219c5831b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:56.856563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159787f4-15e1-412e-a203-c63219c5831b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:56.858029 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159787f4-15e1-412e-a203-c63219c5831b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:56.870375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 402/805] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:56.871560 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99b728-3749-4e14-9179-9e414e79d9f4 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:56.871837 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99b728-3749-4e14-9179-9e414e79d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:56.872107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99b728-3749-4e14-9179-9e414e79d9f4 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:56.877366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 403/806] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:56.877366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99b728-3749-4e14-9179-9e414e79d9f4 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.895012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 404/807] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:08:56 2022] POST /identity/v3/endpoints => generated 337 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:56.895834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd61720-fa44-4a99-b1e4-e587b84c5bc7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:56.898688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:56.901273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.004905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99b728-3749-4e14-9179-9e414e79d9f4 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.028546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd61720-fa44-4a99-b1e4-e587b84c5bc7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.056276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eefb1-c573-4d59-952c-1fcbe5183dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.056926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eefb1-c573-4d59-952c-1fcbe5183dee None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.057202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eefb1-c573-4d59-952c-1fcbe5183dee None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.057471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eefb1-c573-4d59-952c-1fcbe5183dee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.066231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eefb1-c573-4d59-952c-1fcbe5183dee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:57.067607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eefb1-c573-4d59-952c-1fcbe5183dee None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:57.073769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51108a1f-b9e9-4f72-a69c-2b6c3b202e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.074229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51108a1f-b9e9-4f72-a69c-2b6c3b202e4f None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.074505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51108a1f-b9e9-4f72-a69c-2b6c3b202e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.076002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51108a1f-b9e9-4f72-a69c-2b6c3b202e4f None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/78c331b659da48549c4c91e659ff83ba/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.077531 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51108a1f-b9e9-4f72-a69c-2b6c3b202e4f None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=78c331b659da48549c4c91e659ff83ba, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:57.079042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51108a1f-b9e9-4f72-a69c-2b6c3b202e4f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-b94eefb1-c573-4d59-952c-1fcbe5183dee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:57.081853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:57.084796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 404/808] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 31 19:08:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dd5b8-f57d-4b85-9eff-3e0516fb7d68 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.086653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dd5b8-f57d-4b85-9eff-3e0516fb7d68 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.088095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dd5b8-f57d-4b85-9eff-3e0516fb7d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.103328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-935dd5b8-f57d-4b85-9eff-3e0516fb7d68 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:57.106214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-935dd5b8-f57d-4b85-9eff-3e0516fb7d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:57.166844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 405/809] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:56 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/78c331b659da48549c4c91e659ff83ba/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:57.169084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51108a1f-b9e9-4f72-a69c-2b6c3b202e4f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.195908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 405/810] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:57.196987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dd5b8-f57d-4b85-9eff-3e0516fb7d68 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.230093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.274432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.333486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51108a1f-b9e9-4f72-a69c-2b6c3b202e4f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.334682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dd5b8-f57d-4b85-9eff-3e0516fb7d68 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.377052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a64217-20ad-49fd-a8c1-8b0d50eef9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.377650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a64217-20ad-49fd-a8c1-8b0d50eef9ab None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.378070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a64217-20ad-49fd-a8c1-8b0d50eef9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.378840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a64217-20ad-49fd-a8c1-8b0d50eef9ab None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.379596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a64217-20ad-49fd-a8c1-8b0d50eef9ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:57.379906 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a64217-20ad-49fd-a8c1-8b0d50eef9ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:57.381387 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a64217-20ad-49fd-a8c1-8b0d50eef9ab None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:57.382067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c84dcc-5a00-4e39-8aa3-8dd6d0c4969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.382933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c84dcc-5a00-4e39-8aa3-8dd6d0c4969b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.383605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c84dcc-5a00-4e39-8aa3-8dd6d0c4969b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.384075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c84dcc-5a00-4e39-8aa3-8dd6d0c4969b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.385731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c84dcc-5a00-4e39-8aa3-8dd6d0c4969b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:57.387351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c84dcc-5a00-4e39-8aa3-8dd6d0c4969b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-61c84dcc-5a00-4e39-8aa3-8dd6d0c4969b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:57.399696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:57.400793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:08:57.401739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:57.402483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 406/811] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:57.409741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 406/812] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:57.409954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a64217-20ad-49fd-a8c1-8b0d50eef9ab None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.413072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c84dcc-5a00-4e39-8aa3-8dd6d0c4969b None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.511745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.549822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c84dcc-5a00-4e39-8aa3-8dd6d0c4969b None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.555064 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a64217-20ad-49fd-a8c1-8b0d50eef9ab None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.586727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.595393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528c53f-1445-4938-9f45-b984b3e3eb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.596009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528c53f-1445-4938-9f45-b984b3e3eb94 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.600413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528c53f-1445-4938-9f45-b984b3e3eb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.600413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528c53f-1445-4938-9f45-b984b3e3eb94 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.600413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528c53f-1445-4938-9f45-b984b3e3eb94 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:57.600691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c2680-27e6-43c6-b1cd-ae5e293c308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.600804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528c53f-1445-4938-9f45-b984b3e3eb94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:57.600897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c2680-27e6-43c6-b1cd-ae5e293c308a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.600897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c2680-27e6-43c6-b1cd-ae5e293c308a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.600897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c2680-27e6-43c6-b1cd-ae5e293c308a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.601109 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528c53f-1445-4938-9f45-b984b3e3eb94 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:57.604788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 407/813] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:57.605861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528c53f-1445-4938-9f45-b984b3e3eb94 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.683120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c2680-27e6-43c6-b1cd-ae5e293c308a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:57.684569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c2680-27e6-43c6-b1cd-ae5e293c308a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:57.789729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.850034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 407/814] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:08:57.850846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528c53f-1445-4938-9f45-b984b3e3eb94 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:57.850979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c2680-27e6-43c6-b1cd-ae5e293c308a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.890922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a42e1b-66a8-4ac4-a813-0e4b28b792d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:57.891584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a42e1b-66a8-4ac4-a813-0e4b28b792d4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:57.891863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a42e1b-66a8-4ac4-a813-0e4b28b792d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:57.892144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a42e1b-66a8-4ac4-a813-0e4b28b792d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:57.904368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a42e1b-66a8-4ac4-a813-0e4b28b792d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b1a42e1b-66a8-4ac4-a813-0e4b28b792d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:57.909298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:57.910716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:57.911554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 408/815] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:57.913025 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a42e1b-66a8-4ac4-a813-0e4b28b792d4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:57.968473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:57.973364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c2680-27e6-43c6-b1cd-ae5e293c308a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.010334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09767f59-e57a-4790-90a7-b38b0c49c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.010950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09767f59-e57a-4790-90a7-b38b0c49c86f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.011236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09767f59-e57a-4790-90a7-b38b0c49c86f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.011515 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09767f59-e57a-4790-90a7-b38b0c49c86f None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.012270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09767f59-e57a-4790-90a7-b38b0c49c86f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:58.012582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09767f59-e57a-4790-90a7-b38b0c49c86f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.013975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09767f59-e57a-4790-90a7-b38b0c49c86f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.020248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 408/816] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:58.021353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09767f59-e57a-4790-90a7-b38b0c49c86f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.033721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a42e1b-66a8-4ac4-a813-0e4b28b792d4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.056212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:58.086026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10244e5-5bb8-42b5-a24b-62eba872db6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.086837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10244e5-5bb8-42b5-a24b-62eba872db6a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.087327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10244e5-5bb8-42b5-a24b-62eba872db6a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.087437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10244e5-5bb8-42b5-a24b-62eba872db6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.099786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10244e5-5bb8-42b5-a24b-62eba872db6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.101221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10244e5-5bb8-42b5-a24b-62eba872db6a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-f10244e5-5bb8-42b5-a24b-62eba872db6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:58.117122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:58.118321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:58.119675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:58.119675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:58.119675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:58.119675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 409/817] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:58.119675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10244e5-5bb8-42b5-a24b-62eba872db6a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.138257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09767f59-e57a-4790-90a7-b38b0c49c86f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.183595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6c0f-82bb-4981-b9a0-6a8428da46a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.184545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6c0f-82bb-4981-b9a0-6a8428da46a7 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.184888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6c0f-82bb-4981-b9a0-6a8428da46a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.185168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6c0f-82bb-4981-b9a0-6a8428da46a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.185877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d6c0f-82bb-4981-b9a0-6a8428da46a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:58.186184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d6c0f-82bb-4981-b9a0-6a8428da46a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.187551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d6c0f-82bb-4981-b9a0-6a8428da46a7 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.199263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 409/818] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:58.200462 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6c0f-82bb-4981-b9a0-6a8428da46a7 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.258502 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10244e5-5bb8-42b5-a24b-62eba872db6a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.260831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:58.313184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd426-b92b-4d7d-82cb-54297a7754b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.313836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd426-b92b-4d7d-82cb-54297a7754b1 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.314112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd426-b92b-4d7d-82cb-54297a7754b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.314386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd426-b92b-4d7d-82cb-54297a7754b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.315064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bd426-b92b-4d7d-82cb-54297a7754b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.316801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bd426-b92b-4d7d-82cb-54297a7754b1 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.330085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:58.341629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6c0f-82bb-4981-b9a0-6a8428da46a7 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.376072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b5c14-1324-4f18-b23b-a116d2e34830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.376694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5c14-1324-4f18-b23b-a116d2e34830 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.376980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5c14-1324-4f18-b23b-a116d2e34830 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.377254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b5c14-1324-4f18-b23b-a116d2e34830 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.377995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b5c14-1324-4f18-b23b-a116d2e34830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:58.378308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b5c14-1324-4f18-b23b-a116d2e34830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.380240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b5c14-1324-4f18-b23b-a116d2e34830 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.391566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 410/819] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:08:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:58.394352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd426-b92b-4d7d-82cb-54297a7754b1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.408062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 410/820] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:58.417849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b5c14-1324-4f18-b23b-a116d2e34830 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.572456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b5c14-1324-4f18-b23b-a116d2e34830 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.580980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd426-b92b-4d7d-82cb-54297a7754b1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.621694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ce5d0-17d7-4cb7-aef3-582e2caed0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.622587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce5d0-17d7-4cb7-aef3-582e2caed0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.622873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce5d0-17d7-4cb7-aef3-582e2caed0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.623146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce5d0-17d7-4cb7-aef3-582e2caed0d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.627207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e87a6f-ec57-4e58-a563-8362af051d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.627207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e87a6f-ec57-4e58-a563-8362af051d92 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.627556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e87a6f-ec57-4e58-a563-8362af051d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.628072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e87a6f-ec57-4e58-a563-8362af051d92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.634502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ce5d0-17d7-4cb7-aef3-582e2caed0d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.634502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ce5d0-17d7-4cb7-aef3-582e2caed0d1 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.645049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e87a6f-ec57-4e58-a563-8362af051d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.646835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e87a6f-ec57-4e58-a563-8362af051d92 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-e00ce5d0-17d7-4cb7-aef3-582e2caed0d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:58.652192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:58.653552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:58.654902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:58.654902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:58.654902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:58.654902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:58.654902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:58.654902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:58.654902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:58.654902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:58.654902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 411/821] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:08:58.659589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ce5d0-17d7-4cb7-aef3-582e2caed0d1 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-58e87a6f-ec57-4e58-a563-8362af051d92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:58.666048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:58.667006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:58.667903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:58.667903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:58.667903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:58.670296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 411/822] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:58.679746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e87a6f-ec57-4e58-a563-8362af051d92 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.682073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:58.693970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:58.815874 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ce5d0-17d7-4cb7-aef3-582e2caed0d1 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.865613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca376d0b-b5a6-4f6f-9d55-de77a796fc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.866657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca376d0b-b5a6-4f6f-9d55-de77a796fc67 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.866657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca376d0b-b5a6-4f6f-9d55-de77a796fc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.866903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca376d0b-b5a6-4f6f-9d55-de77a796fc67 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.867487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca376d0b-b5a6-4f6f-9d55-de77a796fc67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:58.867797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca376d0b-b5a6-4f6f-9d55-de77a796fc67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.870085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca376d0b-b5a6-4f6f-9d55-de77a796fc67 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.875222 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e87a6f-ec57-4e58-a563-8362af051d92 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:58.894708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 412/823] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:58.903326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca376d0b-b5a6-4f6f-9d55-de77a796fc67 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.919317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab68df-82c2-4474-b46a-42d01fd5d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:58.920032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab68df-82c2-4474-b46a-42d01fd5d269 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:58.920254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab68df-82c2-4474-b46a-42d01fd5d269 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:58.921770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab68df-82c2-4474-b46a-42d01fd5d269 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:58.921770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab68df-82c2-4474-b46a-42d01fd5d269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:58.921770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab68df-82c2-4474-b46a-42d01fd5d269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:58.922922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab68df-82c2-4474-b46a-42d01fd5d269 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:58.936418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 412/824] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:58.942863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab68df-82c2-4474-b46a-42d01fd5d269 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:58.988810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.029516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca376d0b-b5a6-4f6f-9d55-de77a796fc67 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.040746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.074079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab30bfe-ef39-47dc-93ec-b375891e2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.074949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30bfe-ef39-47dc-93ec-b375891e2042 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.074949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30bfe-ef39-47dc-93ec-b375891e2042 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.075394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30bfe-ef39-47dc-93ec-b375891e2042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.076215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab30bfe-ef39-47dc-93ec-b375891e2042 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=799cbde43a3643a4beef892d23145112) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:59.076535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab30bfe-ef39-47dc-93ec-b375891e2042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.078005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab30bfe-ef39-47dc-93ec-b375891e2042 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.085559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 413/825] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/role_assignments?user.id=799cbde43a3643a4beef892d23145112&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:59.090058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab68df-82c2-4474-b46a-42d01fd5d269 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.132622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dd350-2152-40be-bb0e-246719c21423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.133722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dd350-2152-40be-bb0e-246719c21423 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.134261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dd350-2152-40be-bb0e-246719c21423 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.134747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dd350-2152-40be-bb0e-246719c21423 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.145089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dd350-2152-40be-bb0e-246719c21423 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.146949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dd350-2152-40be-bb0e-246719c21423 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.149520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe5a4-4e31-49bf-956e-808d58e2c5df None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.149853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe5a4-4e31-49bf-956e-808d58e2c5df None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.150147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe5a4-4e31-49bf-956e-808d58e2c5df None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.152238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 414/826] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:59.157613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166125d9-f3d7-4855-a451-4074ff807b3a None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.157983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166125d9-f3d7-4855-a451-4074ff807b3a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.158210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166125d9-f3d7-4855-a451-4074ff807b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b50dd350-2152-40be-bb0e-246719c21423 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:59.163436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:59.164435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:59.165353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:59.165353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:59.165353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:59.165353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:59.165353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:59.165353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:59.165353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:59.165353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:59.165353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:08:59.165353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:59.171943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 413/827] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:59.174021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dd350-2152-40be-bb0e-246719c21423 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.187784 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-166125d9-f3d7-4855-a451-4074ff807b3a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:59.190992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-166125d9-f3d7-4855-a451-4074ff807b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:59.290167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 415/828] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:59.314572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dd350-2152-40be-bb0e-246719c21423 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.347184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.355356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352d13c-7977-4829-8a19-acadbca01c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.356094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d13c-7977-4829-8a19-acadbca01c6d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.356480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d13c-7977-4829-8a19-acadbca01c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.356889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d13c-7977-4829-8a19-acadbca01c6d None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.357787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352d13c-7977-4829-8a19-acadbca01c6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:59.358205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352d13c-7977-4829-8a19-acadbca01c6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.359790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352d13c-7977-4829-8a19-acadbca01c6d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.385938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 414/829] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:59.388953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166125d9-f3d7-4855-a451-4074ff807b3a None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.468007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.509500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166125d9-f3d7-4855-a451-4074ff807b3a None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.548023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286697ab-4b18-468b-89b5-bc1cd9f58a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.548926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286697ab-4b18-468b-89b5-bc1cd9f58a02 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.549352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286697ab-4b18-468b-89b5-bc1cd9f58a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.550397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286697ab-4b18-468b-89b5-bc1cd9f58a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.556885 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352d13c-7977-4829-8a19-acadbca01c6d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.564798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286697ab-4b18-468b-89b5-bc1cd9f58a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.567441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286697ab-4b18-468b-89b5-bc1cd9f58a02 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-286697ab-4b18-468b-89b5-bc1cd9f58a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:59.589073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:59.590471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:59.591593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:59.591593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:59.591593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:08:59.591593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 416/830] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:59.595846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286697ab-4b18-468b-89b5-bc1cd9f58a02 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.674750 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352d13c-7977-4829-8a19-acadbca01c6d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.708646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286697ab-4b18-468b-89b5-bc1cd9f58a02 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.720989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e72e0a-afbb-495e-a8ec-cfc8d450c729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.722766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e72e0a-afbb-495e-a8ec-cfc8d450c729 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.723234 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e72e0a-afbb-495e-a8ec-cfc8d450c729 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.723961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e72e0a-afbb-495e-a8ec-cfc8d450c729 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.728940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.741973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e72e0a-afbb-495e-a8ec-cfc8d450c729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:59.747297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9cc43-1c10-41c1-9f95-fd120ada50d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.747991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9cc43-1c10-41c1-9f95-fd120ada50d3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.748336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9cc43-1c10-41c1-9f95-fd120ada50d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-11e72e0a-afbb-495e-a8ec-cfc8d450c729 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:59.749596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:59.750479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:08:59.751098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9cc43-1c10-41c1-9f95-fd120ada50d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.751098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9cc43-1c10-41c1-9f95-fd120ada50d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:59.751098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9cc43-1c10-41c1-9f95-fd120ada50d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.751098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9cc43-1c10-41c1-9f95-fd120ada50d3 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.757939 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 415/831] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:59.759057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e72e0a-afbb-495e-a8ec-cfc8d450c729 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.775231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 417/832] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:59.776508 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9cc43-1c10-41c1-9f95-fd120ada50d3 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.832220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:59.910908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e72e0a-afbb-495e-a8ec-cfc8d450c729 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.916132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9cc43-1c10-41c1-9f95-fd120ada50d3 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:59.949082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb30ff0-3b09-40f5-a78d-957094cacdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.949772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb30ff0-3b09-40f5-a78d-957094cacdaa None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.950012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb30ff0-3b09-40f5-a78d-957094cacdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.950282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb30ff0-3b09-40f5-a78d-957094cacdaa None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.950957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb30ff0-3b09-40f5-a78d-957094cacdaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:59.951257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb30ff0-3b09-40f5-a78d-957094cacdaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.952718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb30ff0-3b09-40f5-a78d-957094cacdaa None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:59.967352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 416/833] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:59.969095 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb30ff0-3b09-40f5-a78d-957094cacdaa None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:59.969535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d44af-54ab-41e7-95ca-8d869126123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:59.970568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d44af-54ab-41e7-95ca-8d869126123b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:59.971060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d44af-54ab-41e7-95ca-8d869126123b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:59.971554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d44af-54ab-41e7-95ca-8d869126123b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:59.982063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d44af-54ab-41e7-95ca-8d869126123b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:59.984719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d44af-54ab-41e7-95ca-8d869126123b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-768d44af-54ab-41e7-95ca-8d869126123b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:00.001456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:00.002481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:00.004126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:00.004126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:00.004126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:00.004126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:00.004126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:00.004126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:00.004126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:00.004126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:00.006252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 418/834] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:00.014200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d44af-54ab-41e7-95ca-8d869126123b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.074088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:00.103984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb30ff0-3b09-40f5-a78d-957094cacdaa None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.114575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:00.151927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d44af-54ab-41e7-95ca-8d869126123b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.158132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36025a-8a1d-41a1-8303-2ee390072d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.159110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36025a-8a1d-41a1-8303-2ee390072d80 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.160211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36025a-8a1d-41a1-8303-2ee390072d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.160720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36025a-8a1d-41a1-8303-2ee390072d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.178212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36025a-8a1d-41a1-8303-2ee390072d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.180018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36025a-8a1d-41a1-8303-2ee390072d80 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.198682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80083fbd-e329-4dce-b359-e10a97f4c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.199449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80083fbd-e329-4dce-b359-e10a97f4c6eb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.199680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80083fbd-e329-4dce-b359-e10a97f4c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.199960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80083fbd-e329-4dce-b359-e10a97f4c6eb None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.200725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80083fbd-e329-4dce-b359-e10a97f4c6eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:00.201038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80083fbd-e329-4dce-b359-e10a97f4c6eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-aa36025a-8a1d-41a1-8303-2ee390072d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:00.202326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:00.203211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:00.204070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:00.204070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:00.204070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:00.204245 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80083fbd-e329-4dce-b359-e10a97f4c6eb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.206647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 417/835] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:00.212398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36025a-8a1d-41a1-8303-2ee390072d80 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.226556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 419/836] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:00.229012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80083fbd-e329-4dce-b359-e10a97f4c6eb None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.339727 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:00.340246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36025a-8a1d-41a1-8303-2ee390072d80 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.344528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80083fbd-e329-4dce-b359-e10a97f4c6eb None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.381808 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5fa36-49dc-4e2d-8996-06c5714f10fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.382934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5fa36-49dc-4e2d-8996-06c5714f10fd None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.383438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5fa36-49dc-4e2d-8996-06c5714f10fd None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.383924 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5fa36-49dc-4e2d-8996-06c5714f10fd None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.384803 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5fa36-49dc-4e2d-8996-06c5714f10fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:00.385402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5fa36-49dc-4e2d-8996-06c5714f10fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.387136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5fa36-49dc-4e2d-8996-06c5714f10fd None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.391095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3ecb3-8827-4ffa-bf8a-356537750033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.391770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3ecb3-8827-4ffa-bf8a-356537750033 None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.392053 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3ecb3-8827-4ffa-bf8a-356537750033 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.392329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3ecb3-8827-4ffa-bf8a-356537750033 None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/de4d78d267af4fe0a6aefed603b0343f/roles/5d7b9f9df87e4195be39d4c61f682b55` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.403205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 418/837] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:00.412244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5fa36-49dc-4e2d-8996-06c5714f10fd None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.414956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3ecb3-8827-4ffa-bf8a-356537750033 None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=de4d78d267af4fe0a6aefed603b0343f, role_id=5d7b9f9df87e4195be39d4c61f682b55)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.417195 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3ecb3-8827-4ffa-bf8a-356537750033 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.450396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:00.526096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 420/838] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:09:00 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/de4d78d267af4fe0a6aefed603b0343f/roles/5d7b9f9df87e4195be39d4c61f682b55 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:09:00.569898 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5fa36-49dc-4e2d-8996-06c5714f10fd None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.570551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13dee1-0aee-4cfb-8967-ea8897fadd80 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.571101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13dee1-0aee-4cfb-8967-ea8897fadd80 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.571380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13dee1-0aee-4cfb-8967-ea8897fadd80 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.572908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 421/839] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:00.578539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ba1c1-729e-4ea6-a4b9-f7500fd419f3 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.578862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ba1c1-729e-4ea6-a4b9-f7500fd419f3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.579115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ba1c1-729e-4ea6-a4b9-f7500fd419f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.599356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-5c3ba1c1-729e-4ea6-a4b9-f7500fd419f3 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:00.600578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-5c3ba1c1-729e-4ea6-a4b9-f7500fd419f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:00.619400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91108ff5-d5fe-4723-927a-00ab893e8b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.620745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91108ff5-d5fe-4723-927a-00ab893e8b19 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.621839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91108ff5-d5fe-4723-927a-00ab893e8b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.622164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91108ff5-d5fe-4723-927a-00ab893e8b19 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.643315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91108ff5-d5fe-4723-927a-00ab893e8b19 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.645529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91108ff5-d5fe-4723-927a-00ab893e8b19 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-91108ff5-d5fe-4723-927a-00ab893e8b19 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:00.661127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:00.662184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:00.663083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:00.663083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:00.663083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:00.663083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:00.663083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:00.663083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:00.663083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:00.663083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:00.663083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:09:00.663083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:00.670732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 419/840] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:00.672116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91108ff5-d5fe-4723-927a-00ab893e8b19 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.689831 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 422/841] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:00.769567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:00.794858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91108ff5-d5fe-4723-927a-00ab893e8b19 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:00.839548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837687d8-29f0-41c3-9bca-fd89c4d92260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:00.840585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837687d8-29f0-41c3-9bca-fd89c4d92260 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:00.841108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837687d8-29f0-41c3-9bca-fd89c4d92260 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:00.841577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837687d8-29f0-41c3-9bca-fd89c4d92260 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:00.842592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837687d8-29f0-41c3-9bca-fd89c4d92260 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:00.843119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837687d8-29f0-41c3-9bca-fd89c4d92260 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:00.844761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837687d8-29f0-41c3-9bca-fd89c4d92260 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:00.865003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 420/842] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 31 19:09:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:00.875452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ba1c1-729e-4ea6-a4b9-f7500fd419f3 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.964832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:00.987338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837687d8-29f0-41c3-9bca-fd89c4d92260 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:00.988686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ba1c1-729e-4ea6-a4b9-f7500fd419f3 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:01.034956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed98fe4-db77-4d2a-a5c5-5cae30e7c2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:01.035953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98fe4-db77-4d2a-a5c5-5cae30e7c2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.036432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98fe4-db77-4d2a-a5c5-5cae30e7c2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.037046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98fe4-db77-4d2a-a5c5-5cae30e7c2c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.133124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed98fe4-db77-4d2a-a5c5-5cae30e7c2c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:01.134640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837687d8-29f0-41c3-9bca-fd89c4d92260 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:01.135455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed98fe4-db77-4d2a-a5c5-5cae30e7c2c0 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:01.180841 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da239dd-db76-4ccd-9977-89a8e1fd109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:01.181554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da239dd-db76-4ccd-9977-89a8e1fd109b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.181862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da239dd-db76-4ccd-9977-89a8e1fd109b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.182138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da239dd-db76-4ccd-9977-89a8e1fd109b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.182736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da239dd-db76-4ccd-9977-89a8e1fd109b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:01.184230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da239dd-db76-4ccd-9977-89a8e1fd109b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:01.187423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-8da239dd-db76-4ccd-9977-89a8e1fd109b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:01.195106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:01.196462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:01.202582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 421/843] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:09:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:01.203430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da239dd-db76-4ccd-9977-89a8e1fd109b None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:01.243190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:01.277070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 423/844] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:01.278717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed98fe4-db77-4d2a-a5c5-5cae30e7c2c0 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:01.343201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da239dd-db76-4ccd-9977-89a8e1fd109b None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:01.380534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783af8e-6a34-4f5b-a4d6-8cc95b3c5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:01.381301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783af8e-6a34-4f5b-a4d6-8cc95b3c5df0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.381585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783af8e-6a34-4f5b-a4d6-8cc95b3c5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.381889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783af8e-6a34-4f5b-a4d6-8cc95b3c5df0 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.382569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783af8e-6a34-4f5b-a4d6-8cc95b3c5df0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:01.382872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783af8e-6a34-4f5b-a4d6-8cc95b3c5df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:01.384310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783af8e-6a34-4f5b-a4d6-8cc95b3c5df0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:01.389424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 422/845] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:09:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:01.390695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b9ced-9115-4bd5-8000-d79cde7f50cf None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.390976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b9ced-9115-4bd5-8000-d79cde7f50cf None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.391254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b9ced-9115-4bd5-8000-d79cde7f50cf None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.392690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 423/846] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:01.398102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b9ced-9115-4bd5-8000-d79cde7f50cf None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:01.419795 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed98fe4-db77-4d2a-a5c5-5cae30e7c2c0 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:01.473634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee515-5f47-4f0f-ac22-9e3e85c3c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:01.474919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee515-5f47-4f0f-ac22-9e3e85c3c751 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.475440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee515-5f47-4f0f-ac22-9e3e85c3c751 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.475949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee515-5f47-4f0f-ac22-9e3e85c3c751 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.487995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:01.497456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee515-5f47-4f0f-ac22-9e3e85c3c751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:01.500416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee515-5f47-4f0f-ac22-9e3e85c3c751 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-8deee515-5f47-4f0f-ac22-9e3e85c3c751 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:01.529555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:01.530794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:01.531880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:01.531880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:01.531880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:01.537473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b9ced-9115-4bd5-8000-d79cde7f50cf None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:01.537581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 424/847] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:01.537581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c08c5-7825-4139-94f0-3e8cd967b47d None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.537581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c08c5-7825-4139-94f0-3e8cd967b47d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.537581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c08c5-7825-4139-94f0-3e8cd967b47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.567372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-750c08c5-7825-4139-94f0-3e8cd967b47d None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:01.569505 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-750c08c5-7825-4139-94f0-3e8cd967b47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:01.575430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101e5f9-bee9-4b78-924d-1384058847ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:01.576365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101e5f9-bee9-4b78-924d-1384058847ae None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.576652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101e5f9-bee9-4b78-924d-1384058847ae None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.577058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101e5f9-bee9-4b78-924d-1384058847ae None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.577740 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101e5f9-bee9-4b78-924d-1384058847ae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:01.578054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101e5f9-bee9-4b78-924d-1384058847ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:01.579448 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101e5f9-bee9-4b78-924d-1384058847ae None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:01.585504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 424/848] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:09:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:01.591505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101e5f9-bee9-4b78-924d-1384058847ae None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:01.619516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:01.681845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 425/849] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:01.743860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101e5f9-bee9-4b78-924d-1384058847ae None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:01.776014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:01.785265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b033ae-2bc9-4109-a5ef-61500c7e8b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:01.785789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b033ae-2bc9-4109-a5ef-61500c7e8b43 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.787863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b033ae-2bc9-4109-a5ef-61500c7e8b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.787863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b033ae-2bc9-4109-a5ef-61500c7e8b43 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.787863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b033ae-2bc9-4109-a5ef-61500c7e8b43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:01.787863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b033ae-2bc9-4109-a5ef-61500c7e8b43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:01.789851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b033ae-2bc9-4109-a5ef-61500c7e8b43 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:01.806018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 425/850] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:01.808062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c08c5-7825-4139-94f0-3e8cd967b47d None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:01.921596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c08c5-7825-4139-94f0-3e8cd967b47d None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:01.957932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bf48b-0583-4f79-aaee-85072994390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:01.958579 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bf48b-0583-4f79-aaee-85072994390f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:01.958859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bf48b-0583-4f79-aaee-85072994390f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:01.959132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bf48b-0583-4f79-aaee-85072994390f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:01.966185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bf48b-0583-4f79-aaee-85072994390f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:01.967630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bf48b-0583-4f79-aaee-85072994390f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:01.973527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b033ae-2bc9-4109-a5ef-61500c7e8b43 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-628bf48b-0583-4f79-aaee-85072994390f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:01.979813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:01.980718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:01.981589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:01.981589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:01.981589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:01.981589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:01.981589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:01.981589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:01.981589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:01.981589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:01.981589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 426/851] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:01.989191 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bf48b-0583-4f79-aaee-85072994390f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:02.025745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:02.145607 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b033ae-2bc9-4109-a5ef-61500c7e8b43 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:02.153301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bf48b-0583-4f79-aaee-85072994390f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:02.194012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbcd4c-7e3d-425f-8e8e-275360ff2537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:02.194956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbcd4c-7e3d-425f-8e8e-275360ff2537 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.195399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbcd4c-7e3d-425f-8e8e-275360ff2537 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.196069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbcd4c-7e3d-425f-8e8e-275360ff2537 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.197438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbcd4c-7e3d-425f-8e8e-275360ff2537 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:02.198690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbcd4c-7e3d-425f-8e8e-275360ff2537 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:02.200753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbcd4c-7e3d-425f-8e8e-275360ff2537 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:02.208755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c038da3-3b8c-43ca-bad6-7d067256b288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:02.209731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c038da3-3b8c-43ca-bad6-7d067256b288 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.210161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c038da3-3b8c-43ca-bad6-7d067256b288 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.210641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c038da3-3b8c-43ca-bad6-7d067256b288 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.211397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c038da3-3b8c-43ca-bad6-7d067256b288 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:02.213734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c038da3-3b8c-43ca-bad6-7d067256b288 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:02.224468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 427/852] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-1c038da3-3b8c-43ca-bad6-7d067256b288 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:02.225088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:02.226121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:09:02.227038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:02.227751 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbcd4c-7e3d-425f-8e8e-275360ff2537 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:02.229983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 426/853] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 31 19:09:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:02.239142 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c038da3-3b8c-43ca-bad6-7d067256b288 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:02.298164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:02.324617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:02.345280 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbcd4c-7e3d-425f-8e8e-275360ff2537 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:02.350203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c038da3-3b8c-43ca-bad6-7d067256b288 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:02.381642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd436-4251-4b7c-9d6d-0ba9a0eeb457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:02.382610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd436-4251-4b7c-9d6d-0ba9a0eeb457 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.383125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd436-4251-4b7c-9d6d-0ba9a0eeb457 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.384702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd436-4251-4b7c-9d6d-0ba9a0eeb457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.385680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd436-4251-4b7c-9d6d-0ba9a0eeb457 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=78c331b659da48549c4c91e659ff83ba) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:02.386230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd436-4251-4b7c-9d6d-0ba9a0eeb457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:02.387699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2da6a-4467-43dd-8e2d-a497527287eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:02.388178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd436-4251-4b7c-9d6d-0ba9a0eeb457 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:02.388293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2da6a-4467-43dd-8e2d-a497527287eb None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.388585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2da6a-4467-43dd-8e2d-a497527287eb None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.388864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2da6a-4467-43dd-8e2d-a497527287eb None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.389499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2da6a-4467-43dd-8e2d-a497527287eb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:02.389834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2da6a-4467-43dd-8e2d-a497527287eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:02.391189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2da6a-4467-43dd-8e2d-a497527287eb None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:02.400611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 428/854] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:02 2022] GET /identity/v3/role_assignments?user.id=78c331b659da48549c4c91e659ff83ba&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:02.400936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 427/855] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:02.405696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2da6a-4467-43dd-8e2d-a497527287eb None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:02.528433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2da6a-4467-43dd-8e2d-a497527287eb None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:02.549121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:02.573343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8437254-7d7d-4a2e-8278-b963b0ea54f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:02.573930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8437254-7d7d-4a2e-8278-b963b0ea54f5 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.574127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8437254-7d7d-4a2e-8278-b963b0ea54f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.574403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8437254-7d7d-4a2e-8278-b963b0ea54f5 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.575072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8437254-7d7d-4a2e-8278-b963b0ea54f5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:02.575407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8437254-7d7d-4a2e-8278-b963b0ea54f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:02.576956 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8437254-7d7d-4a2e-8278-b963b0ea54f5 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:02.586289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 428/856] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:02.638338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820622a-6922-4d07-ae80-f38dcfde5a3f None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.638610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820622a-6922-4d07-ae80-f38dcfde5a3f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.638934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820622a-6922-4d07-ae80-f38dcfde5a3f None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.640419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 429/857] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:02.646489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900c2d-67d0-499e-8c6f-d25fb70d6f3d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:02.646801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900c2d-67d0-499e-8c6f-d25fb70d6f3d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:02.647094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900c2d-67d0-499e-8c6f-d25fb70d6f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:02.669148 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-b5900c2d-67d0-499e-8c6f-d25fb70d6f3d None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:02.670514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b5900c2d-67d0-499e-8c6f-d25fb70d6f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:02.773109 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 429/858] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:03.118654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820622a-6922-4d07-ae80-f38dcfde5a3f None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.230364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820622a-6922-4d07-ae80-f38dcfde5a3f None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.267095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216d9a0-60a2-4786-9984-6b73e16d7aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.267748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216d9a0-60a2-4786-9984-6b73e16d7aac None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.268038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216d9a0-60a2-4786-9984-6b73e16d7aac None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.268315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216d9a0-60a2-4786-9984-6b73e16d7aac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.280718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216d9a0-60a2-4786-9984-6b73e16d7aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-a216d9a0-60a2-4786-9984-6b73e16d7aac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:03.286235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:03.287232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:03.288469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 430/859] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:03.293644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5900c2d-67d0-499e-8c6f-d25fb70d6f3d None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.400534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5900c2d-67d0-499e-8c6f-d25fb70d6f3d None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.413188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.438107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a99a36-05fc-4c7a-ac57-61ec17eef119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.438714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a99a36-05fc-4c7a-ac57-61ec17eef119 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.438994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a99a36-05fc-4c7a-ac57-61ec17eef119 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.439276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a99a36-05fc-4c7a-ac57-61ec17eef119 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.440012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a99a36-05fc-4c7a-ac57-61ec17eef119 None admin] RBAC: Adding query filter params (name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:03.440346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a99a36-05fc-4c7a-ac57-61ec17eef119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.441791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a99a36-05fc-4c7a-ac57-61ec17eef119 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.451643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 430/860] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:03.457382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216d9a0-60a2-4786-9984-6b73e16d7aac None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.470098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.568966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216d9a0-60a2-4786-9984-6b73e16d7aac None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.606937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca6a8f-7731-4fdb-912f-69c6d7d0d747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.607581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca6a8f-7731-4fdb-912f-69c6d7d0d747 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.607865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca6a8f-7731-4fdb-912f-69c6d7d0d747 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.608140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca6a8f-7731-4fdb-912f-69c6d7d0d747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.620224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca6a8f-7731-4fdb-912f-69c6d7d0d747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.621720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca6a8f-7731-4fdb-912f-69c6d7d0d747 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-dcca6a8f-7731-4fdb-912f-69c6d7d0d747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:03.638329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:03.639314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:03.640627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:03.640627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:03.640627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:03.640627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 431/861] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:03.645911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a99a36-05fc-4c7a-ac57-61ec17eef119 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.679657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba63e4-3581-4efd-9d40-1a55526fc07f None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.680019 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba63e4-3581-4efd-9d40-1a55526fc07f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.680271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba63e4-3581-4efd-9d40-1a55526fc07f None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.682109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 432/862] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:03.688749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28a5a3-3f87-4642-8c4a-86be40bef3a5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.689405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28a5a3-3f87-4642-8c4a-86be40bef3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.690011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28a5a3-3f87-4642-8c4a-86be40bef3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.709594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3a28a5a3-3f87-4642-8c4a-86be40bef3a5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:03.711225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3a28a5a3-3f87-4642-8c4a-86be40bef3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:03.778299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:03.783972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a99a36-05fc-4c7a-ac57-61ec17eef119 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.797726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 433/863] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:03.828729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891b6bb-aa30-4be1-8701-38a7e1d73d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.829621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891b6bb-aa30-4be1-8701-38a7e1d73d52 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.830115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891b6bb-aa30-4be1-8701-38a7e1d73d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.830587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891b6bb-aa30-4be1-8701-38a7e1d73d52 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:03.831943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891b6bb-aa30-4be1-8701-38a7e1d73d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:03.832678 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891b6bb-aa30-4be1-8701-38a7e1d73d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:03.833798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891b6bb-aa30-4be1-8701-38a7e1d73d52 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:03.848299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 431/864] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:03.853900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28a5a3-3f87-4642-8c4a-86be40bef3a5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:03.956825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28a5a3-3f87-4642-8c4a-86be40bef3a5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:03.993968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3cbf6-756e-432a-b9a5-a501c10c8e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:03.994609 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3cbf6-756e-432a-b9a5-a501c10c8e6f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:03.994893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3cbf6-756e-432a-b9a5-a501c10c8e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:03.995172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3cbf6-756e-432a-b9a5-a501c10c8e6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.003027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3cbf6-756e-432a-b9a5-a501c10c8e6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:04.004486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3cbf6-756e-432a-b9a5-a501c10c8e6f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-a3f3cbf6-756e-432a-b9a5-a501c10c8e6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:04.017327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:04.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:04.019887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 434/865] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 31 19:09:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:04.025039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891b6bb-aa30-4be1-8701-38a7e1d73d52 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:04.064629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:04.089338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3cbf6-756e-432a-b9a5-a501c10c8e6f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:04.146297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:04.153884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891b6bb-aa30-4be1-8701-38a7e1d73d52 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:04.201630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f8a3e-386f-4791-b74a-962351fede82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:04.202550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f8a3e-386f-4791-b74a-962351fede82 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.203238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f8a3e-386f-4791-b74a-962351fede82 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.203698 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f8a3e-386f-4791-b74a-962351fede82 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.204769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f8a3e-386f-4791-b74a-962351fede82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:04.205570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f8a3e-386f-4791-b74a-962351fede82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:04.208084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f8a3e-386f-4791-b74a-962351fede82 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:04.215920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3cbf6-756e-432a-b9a5-a501c10c8e6f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:04.239668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 432/866] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 31 19:09:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:04.240873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f8a3e-386f-4791-b74a-962351fede82 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:04.257241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4fca9-6ad0-4fe0-bfc9-52fd23c2cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:04.258298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4fca9-6ad0-4fe0-bfc9-52fd23c2cfbb None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.258760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4fca9-6ad0-4fe0-bfc9-52fd23c2cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.259325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4fca9-6ad0-4fe0-bfc9-52fd23c2cfbb None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.260205 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4fca9-6ad0-4fe0-bfc9-52fd23c2cfbb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:04.262107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4fca9-6ad0-4fe0-bfc9-52fd23c2cfbb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:04.351681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:04.361503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f8a3e-386f-4791-b74a-962351fede82 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:04.392220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 435/867] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:09:04 2022] POST /identity/v3/services => generated 251 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:09:04.418904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb02c5f-93bb-4896-9857-33f0f6b426ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:04.420018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb02c5f-93bb-4896-9857-33f0f6b426ff None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.420503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb02c5f-93bb-4896-9857-33f0f6b426ff None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.421065 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb02c5f-93bb-4896-9857-33f0f6b426ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.513947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb02c5f-93bb-4896-9857-33f0f6b426ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:04.516123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb02c5f-93bb-4896-9857-33f0f6b426ff None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:04.604842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15d11-880b-47b6-aafc-da61478e3f21 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.605552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15d11-880b-47b6-aafc-da61478e3f21 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.606106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15d11-880b-47b6-aafc-da61478e3f21 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.608954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 436/868] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:04.616219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94deca9-09de-4042-bf62-52f13486e2d9 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.616861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94deca9-09de-4042-bf62-52f13486e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.618340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94deca9-09de-4042-bf62-52f13486e2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.646060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:04.655820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 433/869] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:04 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:04.664652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b94deca9-09de-4042-bf62-52f13486e2d9 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:04.667280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb02c5f-93bb-4896-9857-33f0f6b426ff None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:04.668987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b94deca9-09de-4042-bf62-52f13486e2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:04.764732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 437/870] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:04.766323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589a99-3b9f-4560-9173-4302292e838c None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.766720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589a99-3b9f-4560-9173-4302292e838c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.767103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589a99-3b9f-4560-9173-4302292e838c None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.772630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 438/871] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:04.774085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf20e4-1b2c-4af8-8f9d-199b8a655463 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.774471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf20e4-1b2c-4af8-8f9d-199b8a655463 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.774846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf20e4-1b2c-4af8-8f9d-199b8a655463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.794880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3cbf20e4-1b2c-4af8-8f9d-199b8a655463 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:04.796134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3cbf20e4-1b2c-4af8-8f9d-199b8a655463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:04.816733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb02c5f-93bb-4896-9857-33f0f6b426ff None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:04.837094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:04.866920 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aabea-7e86-4709-8ff2-3a1e0a3c8854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:04.868011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aabea-7e86-4709-8ff2-3a1e0a3c8854 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:04.868465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aabea-7e86-4709-8ff2-3a1e0a3c8854 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:04.869489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aabea-7e86-4709-8ff2-3a1e0a3c8854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:04.887093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 439/872] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:04.890615 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aabea-7e86-4709-8ff2-3a1e0a3c8854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:04.892294 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aabea-7e86-4709-8ff2-3a1e0a3c8854 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-3f7aabea-7e86-4709-8ff2-3a1e0a3c8854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:04.909821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:04.911010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:04.912078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:04.912078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:04.912078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:04.913533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 434/873] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:04.919242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf20e4-1b2c-4af8-8f9d-199b8a655463 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:05.035239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf20e4-1b2c-4af8-8f9d-199b8a655463 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:05.044322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aabea-7e86-4709-8ff2-3a1e0a3c8854 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:05.089320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e62520-daf2-456d-8190-647ecfc1ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:05.090003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e62520-daf2-456d-8190-647ecfc1ca55 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:05.090288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e62520-daf2-456d-8190-647ecfc1ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:05.090563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e62520-daf2-456d-8190-647ecfc1ca55 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:05.091231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e62520-daf2-456d-8190-647ecfc1ca55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:05.091533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e62520-daf2-456d-8190-647ecfc1ca55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:05.092941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e62520-daf2-456d-8190-647ecfc1ca55 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:05.093807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:05.109543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 440/874] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:05.115437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e62520-daf2-456d-8190-647ecfc1ca55 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:05.150251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:05.167016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aabea-7e86-4709-8ff2-3a1e0a3c8854 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:05.205102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f145d72-a929-45b8-b9c1-d8a441d77111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:05.205740 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f145d72-a929-45b8-b9c1-d8a441d77111 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:05.206178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f145d72-a929-45b8-b9c1-d8a441d77111 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:05.206457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f145d72-a929-45b8-b9c1-d8a441d77111 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:05.207124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f145d72-a929-45b8-b9c1-d8a441d77111 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:05.208512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f145d72-a929-45b8-b9c1-d8a441d77111 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:05.229060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e62520-daf2-456d-8190-647ecfc1ca55 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:05.263180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a11c0-3d4d-4ce7-9897-42c9cd265ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:05.263812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a11c0-3d4d-4ce7-9897-42c9cd265ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:05.264132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a11c0-3d4d-4ce7-9897-42c9cd265ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:05.264374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a11c0-3d4d-4ce7-9897-42c9cd265ce3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:05.272037 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a11c0-3d4d-4ce7-9897-42c9cd265ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:05.274588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a11c0-3d4d-4ce7-9897-42c9cd265ce3 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-647a11c0-3d4d-4ce7-9897-42c9cd265ce3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:05.285883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:05.287063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:05.288052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:05.288052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:05.288052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:05.288052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:05.288052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:05.288052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:05.288052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:05.288052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:05.288052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 441/875] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:05.288052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a11c0-3d4d-4ce7-9897-42c9cd265ce3 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:05.300609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 435/876] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:09:05 2022] POST /identity/v3/services => generated 269 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:09:05.321833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f145d72-a929-45b8-b9c1-d8a441d77111 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:05.417543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:05.438356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:05.440098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a11c0-3d4d-4ce7-9897-42c9cd265ce3 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:05.454248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f145d72-a929-45b8-b9c1-d8a441d77111 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:05.493907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc57b9-6d87-46e5-9845-a369986c673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:05.495014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc57b9-6d87-46e5-9845-a369986c673d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:05.495364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc57b9-6d87-46e5-9845-a369986c673d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:05.495650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc57b9-6d87-46e5-9845-a369986c673d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:05.496253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc57b9-6d87-46e5-9845-a369986c673d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:05.497822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc57b9-6d87-46e5-9845-a369986c673d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:05.501511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3f2bc-8b9c-4dc2-82fa-ce5521684946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:05.502579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3f2bc-8b9c-4dc2-82fa-ce5521684946 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:05.503072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3f2bc-8b9c-4dc2-82fa-ce5521684946 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:05.503521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3f2bc-8b9c-4dc2-82fa-ce5521684946 None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:05.504407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3f2bc-8b9c-4dc2-82fa-ce5521684946 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:05.504887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3f2bc-8b9c-4dc2-82fa-ce5521684946 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:05.506587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3f2bc-8b9c-4dc2-82fa-ce5521684946 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-2afc57b9-6d87-46e5-9845-a369986c673d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:05.509230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:05.510237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:05.511137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 442/877] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:05.522571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc57b9-6d87-46e5-9845-a369986c673d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:05.538806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 436/878] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:05.549775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3f2bc-8b9c-4dc2-82fa-ce5521684946 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:05.708479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc57b9-6d87-46e5-9845-a369986c673d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:05.732620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3f2bc-8b9c-4dc2-82fa-ce5521684946 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:05.771863 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f58c1-9fa6-43fb-bf5d-b2f5208674ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:05.772984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f58c1-9fa6-43fb-bf5d-b2f5208674ed None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:05.773490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f58c1-9fa6-43fb-bf5d-b2f5208674ed None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:05.774027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f58c1-9fa6-43fb-bf5d-b2f5208674ed None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:05.775469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f58c1-9fa6-43fb-bf5d-b2f5208674ed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:05.775996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f58c1-9fa6-43fb-bf5d-b2f5208674ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:05.776541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca25b2c-6457-4110-bf0b-0e50de63dfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:05.777392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25b2c-6457-4110-bf0b-0e50de63dfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:05.777980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25b2c-6457-4110-bf0b-0e50de63dfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:05.778483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25b2c-6457-4110-bf0b-0e50de63dfe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:05.778587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f58c1-9fa6-43fb-bf5d-b2f5208674ed None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:05.779521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca25b2c-6457-4110-bf0b-0e50de63dfe4 None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=de4d78d267af4fe0a6aefed603b0343f) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:05.780041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca25b2c-6457-4110-bf0b-0e50de63dfe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:05.782007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca25b2c-6457-4110-bf0b-0e50de63dfe4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:05.794087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 443/880] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 31 19:09:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:05.794496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 437/880] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:05 2022] GET /identity/v3/role_assignments?user.id=de4d78d267af4fe0a6aefed603b0343f&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:05.798856 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f58c1-9fa6-43fb-bf5d-b2f5208674ed None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:05.844010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:06.001439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f58c1-9fa6-43fb-bf5d-b2f5208674ed None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:06.051701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0dc5f-efde-4f9e-842f-01e1dd9f0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:06.052702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0dc5f-efde-4f9e-842f-01e1dd9f0f13 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:06.053309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0dc5f-efde-4f9e-842f-01e1dd9f0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:06.053801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0dc5f-efde-4f9e-842f-01e1dd9f0f13 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:06.054606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0dc5f-efde-4f9e-842f-01e1dd9f0f13 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:06.055044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0dc5f-efde-4f9e-842f-01e1dd9f0f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:06.056535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0dc5f-efde-4f9e-842f-01e1dd9f0f13 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:06.063044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 444/881] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 31 19:09:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:06.494330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc337c-128e-46a2-b29d-59b2979305e9 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:06.494850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc337c-128e-46a2-b29d-59b2979305e9 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:06.494959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc337c-128e-46a2-b29d-59b2979305e9 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:06.496507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 438/882] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:06.502093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade113e0-9ec1-4f35-9ce3-713cf5d1231f None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:06.502653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade113e0-9ec1-4f35-9ce3-713cf5d1231f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:06.502653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade113e0-9ec1-4f35-9ce3-713cf5d1231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:06.527120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ade113e0-9ec1-4f35-9ce3-713cf5d1231f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:06.528543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ade113e0-9ec1-4f35-9ce3-713cf5d1231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:06.644375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 445/883] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:06.932704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc337c-128e-46a2-b29d-59b2979305e9 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:06.954680 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:07.087646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc337c-128e-46a2-b29d-59b2979305e9 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.126102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71d3de-86a5-4eed-aa27-7898853a45f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.126748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d3de-86a5-4eed-aa27-7898853a45f7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.127026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d3de-86a5-4eed-aa27-7898853a45f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.127298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d3de-86a5-4eed-aa27-7898853a45f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.127959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71d3de-86a5-4eed-aa27-7898853a45f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.129401 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71d3de-86a5-4eed-aa27-7898853a45f7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-db71d3de-86a5-4eed-aa27-7898853a45f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:07.139111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:07.140146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:07.141223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 439/884] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:09:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:07.151181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade113e0-9ec1-4f35-9ce3-713cf5d1231f None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.164088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:07.270983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade113e0-9ec1-4f35-9ce3-713cf5d1231f None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.308059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e53c2-81eb-40ec-b349-0d78335a33ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.308682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e53c2-81eb-40ec-b349-0d78335a33ca None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.308971 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e53c2-81eb-40ec-b349-0d78335a33ca None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.309238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e53c2-81eb-40ec-b349-0d78335a33ca None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.309926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e53c2-81eb-40ec-b349-0d78335a33ca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:07.310224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e53c2-81eb-40ec-b349-0d78335a33ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.311607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e53c2-81eb-40ec-b349-0d78335a33ca None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.317966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 446/885] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:07.323900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71d3de-86a5-4eed-aa27-7898853a45f7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.327177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4db24-2518-4a8a-9b17-46b1f32c247c None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.327497 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4db24-2518-4a8a-9b17-46b1f32c247c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.327780 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4db24-2518-4a8a-9b17-46b1f32c247c None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.329170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 447/886] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:07.335730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00595fa0-1365-437d-a365-d3cc6b1a75a2 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.336041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00595fa0-1365-437d-a365-d3cc6b1a75a2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.336298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00595fa0-1365-437d-a365-d3cc6b1a75a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.357054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-00595fa0-1365-437d-a365-d3cc6b1a75a2 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:07.358361 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-00595fa0-1365-437d-a365-d3cc6b1a75a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:07.439328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:07.453895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 448/887] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:07.475062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71d3de-86a5-4eed-aa27-7898853a45f7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.550085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea446e-bc91-4b65-8850-5a378e9a44b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.550844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea446e-bc91-4b65-8850-5a378e9a44b7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.551095 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea446e-bc91-4b65-8850-5a378e9a44b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.551460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea446e-bc91-4b65-8850-5a378e9a44b7 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.552150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea446e-bc91-4b65-8850-5a378e9a44b7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:07.552536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea446e-bc91-4b65-8850-5a378e9a44b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.554182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea446e-bc91-4b65-8850-5a378e9a44b7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.564463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 440/888] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:07.575030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00595fa0-1365-437d-a365-d3cc6b1a75a2 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.588578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:07.693198 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00595fa0-1365-437d-a365-d3cc6b1a75a2 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.731055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9dce-9aa4-4c0d-8512-962018cdefe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.731681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9dce-9aa4-4c0d-8512-962018cdefe9 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.731963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9dce-9aa4-4c0d-8512-962018cdefe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.732241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9dce-9aa4-4c0d-8512-962018cdefe9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.733032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e9dce-9aa4-4c0d-8512-962018cdefe9 None admin] RBAC: Adding query filter params (interface=public, service_id=786e8124d6d844dfbfdb9c6fff42627c, region_id=RegionOne) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:07.733351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e9dce-9aa4-4c0d-8512-962018cdefe9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.734769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e9dce-9aa4-4c0d-8512-962018cdefe9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.743876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 449/889] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/endpoints?service_id=786e8124d6d844dfbfdb9c6fff42627c&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:07.747116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea446e-bc91-4b65-8850-5a378e9a44b7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.749365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9dce-9aa4-4c0d-8512-962018cdefe9 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.847203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:07.898830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9dce-9aa4-4c0d-8512-962018cdefe9 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.903432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea446e-bc91-4b65-8850-5a378e9a44b7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:07.950530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43e365-c70b-4f7e-907b-161560cc6678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.951583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43e365-c70b-4f7e-907b-161560cc6678 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.952105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43e365-c70b-4f7e-907b-161560cc6678 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.952249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe427e-6fc7-4f33-a23f-a02661c40ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:07.952455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43e365-c70b-4f7e-907b-161560cc6678 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.952966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe427e-6fc7-4f33-a23f-a02661c40ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.953082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43e365-c70b-4f7e-907b-161560cc6678 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.953377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe427e-6fc7-4f33-a23f-a02661c40ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.953790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe427e-6fc7-4f33-a23f-a02661c40ba6 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.954508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43e365-c70b-4f7e-907b-161560cc6678 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.954666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe427e-6fc7-4f33-a23f-a02661c40ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:07.956201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe427e-6fc7-4f33-a23f-a02661c40ba6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:07.962691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 450/890] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/services => generated 1268 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:09:07.963785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ff59a-4eb0-432f-8f17-0a9002515633 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.964070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ff59a-4eb0-432f-8f17-0a9002515633 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.964348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ff59a-4eb0-432f-8f17-0a9002515633 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.966887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 451/891] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-9d43e365-c70b-4f7e-907b-161560cc6678 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:07.968541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:07.969624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:07.975087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 441/892] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:07.978330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6dd09-9c30-480e-8a65-1be63b06ff82 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:07.978330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6dd09-9c30-480e-8a65-1be63b06ff82 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:07.978330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6dd09-9c30-480e-8a65-1be63b06ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:07.980146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43e365-c70b-4f7e-907b-161560cc6678 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:07.995519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.002418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-bca6dd09-9c30-480e-8a65-1be63b06ff82 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:08.004091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bca6dd09-9c30-480e-8a65-1be63b06ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:08.117713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 452/893] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:08.121362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43e365-c70b-4f7e-907b-161560cc6678 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.122246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07475-e57c-48b7-ad50-21b7c9f2619c None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.122660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07475-e57c-48b7-ad50-21b7c9f2619c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.122954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07475-e57c-48b7-ad50-21b7c9f2619c None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.124521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 453/894] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:08.130587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6e380-4498-4503-8534-ee2078dc3f39 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.130869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6e380-4498-4503-8534-ee2078dc3f39 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.131145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6e380-4498-4503-8534-ee2078dc3f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.151437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-08e6e380-4498-4503-8534-ee2078dc3f39 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:08.152796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-08e6e380-4498-4503-8534-ee2078dc3f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:08.165462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0e14b-d805-48ac-b9c1-f60c84e6438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.166145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0e14b-d805-48ac-b9c1-f60c84e6438e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.166422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0e14b-d805-48ac-b9c1-f60c84e6438e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.167108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0e14b-d805-48ac-b9c1-f60c84e6438e None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.167384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0e14b-d805-48ac-b9c1-f60c84e6438e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:08.168527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0e14b-d805-48ac-b9c1-f60c84e6438e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.169080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0e14b-d805-48ac-b9c1-f60c84e6438e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:08.176002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 442/895] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:08.183765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0e14b-d805-48ac-b9c1-f60c84e6438e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:08.227097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.242194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 454/896] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:08.290151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.307450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0e14b-d805-48ac-b9c1-f60c84e6438e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.345266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3129-95bc-4b7f-9dbb-54ff1901965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.345916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3129-95bc-4b7f-9dbb-54ff1901965b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.346203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3129-95bc-4b7f-9dbb-54ff1901965b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.347024 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3129-95bc-4b7f-9dbb-54ff1901965b None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.347690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b3129-95bc-4b7f-9dbb-54ff1901965b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:08.347993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b3129-95bc-4b7f-9dbb-54ff1901965b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.349382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b3129-95bc-4b7f-9dbb-54ff1901965b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:08.360031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 443/897] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:08.361484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6e380-4498-4503-8534-ee2078dc3f39 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:08.412200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3129-95bc-4b7f-9dbb-54ff1901965b None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:08.490968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6e380-4498-4503-8534-ee2078dc3f39 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.533132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918de77b-f207-4da9-81df-339af1d438e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.533775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918de77b-f207-4da9-81df-339af1d438e4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.534621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918de77b-f207-4da9-81df-339af1d438e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.534900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918de77b-f207-4da9-81df-339af1d438e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.535606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918de77b-f207-4da9-81df-339af1d438e4 None admin] RBAC: Adding query filter params (interface=public, service_id=2ec8bd24179f4c3ab6f219582040bc75, region_id=RegionOne) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:08.535911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918de77b-f207-4da9-81df-339af1d438e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.536339 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3129-95bc-4b7f-9dbb-54ff1901965b None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.537270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918de77b-f207-4da9-81df-339af1d438e4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:08.546968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 455/898] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 31 19:09:08 2022] GET /identity/v3/endpoints?service_id=2ec8bd24179f4c3ab6f219582040bc75&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:08.547911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918de77b-f207-4da9-81df-339af1d438e4 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:08.574011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb47f3-35b7-4aa5-9a7f-c4cd774f6fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.574656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb47f3-35b7-4aa5-9a7f-c4cd774f6fcd None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.574944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb47f3-35b7-4aa5-9a7f-c4cd774f6fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.575222 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb47f3-35b7-4aa5-9a7f-c4cd774f6fcd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.583462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.587330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb47f3-35b7-4aa5-9a7f-c4cd774f6fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-9acb47f3-35b7-4aa5-9a7f-c4cd774f6fcd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:08.592346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:08.598392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 444/899] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 31 19:09:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:08.599758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb47f3-35b7-4aa5-9a7f-c4cd774f6fcd None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:08.625563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.701384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918de77b-f207-4da9-81df-339af1d438e4 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.741378 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb47f3-35b7-4aa5-9a7f-c4cd774f6fcd None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.743458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0c2a8-0440-4b73-a06d-5da98069ebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.744995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c2a8-0440-4b73-a06d-5da98069ebff None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.745275 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c2a8-0440-4b73-a06d-5da98069ebff None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.745549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c2a8-0440-4b73-a06d-5da98069ebff None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.746248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0c2a8-0440-4b73-a06d-5da98069ebff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.747607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0c2a8-0440-4b73-a06d-5da98069ebff None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:08.776613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aba4d-aa68-44c9-8d19-cc41d7258251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.777216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aba4d-aa68-44c9-8d19-cc41d7258251 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.777494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aba4d-aa68-44c9-8d19-cc41d7258251 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.777795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aba4d-aa68-44c9-8d19-cc41d7258251 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.778434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aba4d-aa68-44c9-8d19-cc41d7258251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.779801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aba4d-aa68-44c9-8d19-cc41d7258251 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:08.785594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 445/900] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 31 19:09:08 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:09:08.789517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aba4d-aa68-44c9-8d19-cc41d7258251 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:08.824832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 456/901] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:09:08 2022] POST /identity/v3/services => generated 241 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:08.887342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:08.937843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aba4d-aa68-44c9-8d19-cc41d7258251 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:08.988732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520532c-656f-4428-b3bf-b677f323bda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:08.989356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520532c-656f-4428-b3bf-b677f323bda4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:08.989630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520532c-656f-4428-b3bf-b677f323bda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:08.992270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520532c-656f-4428-b3bf-b677f323bda4 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:08.992270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520532c-656f-4428-b3bf-b677f323bda4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:08.992270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520532c-656f-4428-b3bf-b677f323bda4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:08.992540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520532c-656f-4428-b3bf-b677f323bda4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:09.003159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 446/902] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 31 19:09:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:09.008818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0c2a8-0440-4b73-a06d-5da98069ebff None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:09.123583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0c2a8-0440-4b73-a06d-5da98069ebff None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:09.139452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:09.160246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec7c0-e939-4d38-a578-35aad7ad14e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:09.160885 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec7c0-e939-4d38-a578-35aad7ad14e2 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:09.161165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec7c0-e939-4d38-a578-35aad7ad14e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:09.161437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec7c0-e939-4d38-a578-35aad7ad14e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:09.172938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdec7c0-e939-4d38-a578-35aad7ad14e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:09.175024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdec7c0-e939-4d38-a578-35aad7ad14e2 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-abdec7c0-e939-4d38-a578-35aad7ad14e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:09.192666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:09.199084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:09.200112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:09.200112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:09.200112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:09.200112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 457/903] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:09.200347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520532c-656f-4428-b3bf-b677f323bda4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:09.309464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520532c-656f-4428-b3bf-b677f323bda4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:09.330939 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:09.344945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383c9ab-05cf-4161-be4e-c89ece86d992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:09.347131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383c9ab-05cf-4161-be4e-c89ece86d992 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:09.347131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383c9ab-05cf-4161-be4e-c89ece86d992 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:09.347131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383c9ab-05cf-4161-be4e-c89ece86d992 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:09.347131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383c9ab-05cf-4161-be4e-c89ece86d992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:09.347407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383c9ab-05cf-4161-be4e-c89ece86d992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:09.348595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383c9ab-05cf-4161-be4e-c89ece86d992 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:09.366026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 447/904] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:09.367976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec7c0-e939-4d38-a578-35aad7ad14e2 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:09.479601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec7c0-e939-4d38-a578-35aad7ad14e2 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:09.517567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4e306-ea6d-426d-8c18-8171201b0c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:09.518654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4e306-ea6d-426d-8c18-8171201b0c15 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:09.519102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4e306-ea6d-426d-8c18-8171201b0c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:09.519527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4e306-ea6d-426d-8c18-8171201b0c15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:09.528747 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4e306-ea6d-426d-8c18-8171201b0c15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:09.530603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4e306-ea6d-426d-8c18-8171201b0c15 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-dac4e306-ea6d-426d-8c18-8171201b0c15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:09.543566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:09.544769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:09.545957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:09.545957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:09.545957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:09.545957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:09.545957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:09.545957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:09.545957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:09.545957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:09.545957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:09:09.545957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:09.548364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 458/905] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 31 19:09:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:09.554530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383c9ab-05cf-4161-be4e-c89ece86d992 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:09.667814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383c9ab-05cf-4161-be4e-c89ece86d992 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:09.705366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788073-cd2a-4b81-b7f7-0c445931d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:09.706035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788073-cd2a-4b81-b7f7-0c445931d57e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:09.706318 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788073-cd2a-4b81-b7f7-0c445931d57e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:09.706597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788073-cd2a-4b81-b7f7-0c445931d57e None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:09.707338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c788073-cd2a-4b81-b7f7-0c445931d57e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:09.707646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c788073-cd2a-4b81-b7f7-0c445931d57e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:09.709090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c788073-cd2a-4b81-b7f7-0c445931d57e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:09.728639 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 448/906] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 31 19:09:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:09.734546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4e306-ea6d-426d-8c18-8171201b0c15 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:09.765695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:09.847456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4e306-ea6d-426d-8c18-8171201b0c15 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:09.883149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0407ed8-b0e1-411f-9fb2-e67d8d60088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:09.883763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0407ed8-b0e1-411f-9fb2-e67d8d60088c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:09.884044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0407ed8-b0e1-411f-9fb2-e67d8d60088c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:09.884323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0407ed8-b0e1-411f-9fb2-e67d8d60088c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:09.962278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0407ed8-b0e1-411f-9fb2-e67d8d60088c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:09.963899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0407ed8-b0e1-411f-9fb2-e67d8d60088c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:10.006900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:10.091815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 459/907] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:09 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:10.097952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788073-cd2a-4b81-b7f7-0c445931d57e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:10.111982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e346594-48eb-451b-bbc5-d1f9a31ebba2 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.112738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e346594-48eb-451b-bbc5-d1f9a31ebba2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.113028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e346594-48eb-451b-bbc5-d1f9a31ebba2 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.115208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 460/908] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:10.121142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca145cc-57eb-4169-a03a-4ed3d673c6a5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.121744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca145cc-57eb-4169-a03a-4ed3d673c6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.122033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca145cc-57eb-4169-a03a-4ed3d673c6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.142975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3ca145cc-57eb-4169-a03a-4ed3d673c6a5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:10.144750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3ca145cc-57eb-4169-a03a-4ed3d673c6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:10.154528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:10.229889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 461/909] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:10.240347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788073-cd2a-4b81-b7f7-0c445931d57e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:10.286110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1f5d6-7d2c-4615-b0a2-cce18e229473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:10.286771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f5d6-7d2c-4615-b0a2-cce18e229473 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.287054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f5d6-7d2c-4615-b0a2-cce18e229473 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.287330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f5d6-7d2c-4615-b0a2-cce18e229473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.299720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1f5d6-7d2c-4615-b0a2-cce18e229473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:10.301200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1f5d6-7d2c-4615-b0a2-cce18e229473 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-a1a1f5d6-7d2c-4615-b0a2-cce18e229473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:10.319126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:10.320138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:10.321247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:10.321247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:10.321247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:10.321247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 449/910] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:10.326838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca145cc-57eb-4169-a03a-4ed3d673c6a5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:10.396367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:10.444732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca145cc-57eb-4169-a03a-4ed3d673c6a5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:10.481315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4d93c-0337-4d01-9f00-e7d999eaba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:10.481869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4d93c-0337-4d01-9f00-e7d999eaba1d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.482151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4d93c-0337-4d01-9f00-e7d999eaba1d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.482425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4d93c-0337-4d01-9f00-e7d999eaba1d None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.483072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4d93c-0337-4d01-9f00-e7d999eaba1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:10.483375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4d93c-0337-4d01-9f00-e7d999eaba1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:10.484737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4d93c-0337-4d01-9f00-e7d999eaba1d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:10.497065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 462/911] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:10.503143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1f5d6-7d2c-4615-b0a2-cce18e229473 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:10.515851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4d93c-0337-4d01-9f00-e7d999eaba1d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:10.604010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:10.615196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1f5d6-7d2c-4615-b0a2-cce18e229473 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:10.622482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4d93c-0337-4d01-9f00-e7d999eaba1d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:10.652238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13d5eb-42b3-4e8d-b5f3-6d8a317bf71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:10.653121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13d5eb-42b3-4e8d-b5f3-6d8a317bf71a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.653538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13d5eb-42b3-4e8d-b5f3-6d8a317bf71a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.653989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13d5eb-42b3-4e8d-b5f3-6d8a317bf71a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.658545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c0508-54bf-4141-b3b2-4dd8d07f4890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:10.659426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0508-54bf-4141-b3b2-4dd8d07f4890 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.659867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0508-54bf-4141-b3b2-4dd8d07f4890 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.660236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0508-54bf-4141-b3b2-4dd8d07f4890 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.660979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c0508-54bf-4141-b3b2-4dd8d07f4890 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:10.662499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c0508-54bf-4141-b3b2-4dd8d07f4890 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:10.663425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13d5eb-42b3-4e8d-b5f3-6d8a317bf71a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:10.665010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13d5eb-42b3-4e8d-b5f3-6d8a317bf71a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:10.666066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-a33c0508-54bf-4141-b3b2-4dd8d07f4890 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:10.675916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:10.677152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:09:10.678122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-fa13d5eb-42b3-4e8d-b5f3-6d8a317bf71a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:10.681458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:10.682707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:10.683584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:10.683584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:10.683584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:10.683584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:10.683584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:10.683584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:10.683584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:10.683584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:10.684001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 463/912] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:09:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:10.685568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c0508-54bf-4141-b3b2-4dd8d07f4890 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:10.691130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 450/913] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:10.692586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13d5eb-42b3-4e8d-b5f3-6d8a317bf71a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:10.810207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13d5eb-42b3-4e8d-b5f3-6d8a317bf71a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:10.837031 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c0508-54bf-4141-b3b2-4dd8d07f4890 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:10.863165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f2afe-60dd-4ae1-a396-3266b2b0daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:10.863765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f2afe-60dd-4ae1-a396-3266b2b0daaf None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.864047 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f2afe-60dd-4ae1-a396-3266b2b0daaf None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.864327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f2afe-60dd-4ae1-a396-3266b2b0daaf None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.865048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f2afe-60dd-4ae1-a396-3266b2b0daaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:10.865355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f2afe-60dd-4ae1-a396-3266b2b0daaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:10.866830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f2afe-60dd-4ae1-a396-3266b2b0daaf None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:10.873944 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66d909-0457-42f6-aec7-224c778271da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:10.874559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66d909-0457-42f6-aec7-224c778271da None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.874843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66d909-0457-42f6-aec7-224c778271da None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.875116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66d909-0457-42f6-aec7-224c778271da None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.875924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66d909-0457-42f6-aec7-224c778271da None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:10.876234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66d909-0457-42f6-aec7-224c778271da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:10.878298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66d909-0457-42f6-aec7-224c778271da None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:10.880798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 451/914] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:10.882088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd0652-3bc4-4a4b-8d13-6f16e84f92dc None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.882380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd0652-3bc4-4a4b-8d13-6f16e84f92dc None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.882662 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd0652-3bc4-4a4b-8d13-6f16e84f92dc None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.884052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 452/915] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:10.888703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 464/916] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:09:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:10.888955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd0652-3bc4-4a4b-8d13-6f16e84f92dc None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:10.892945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b941-49fb-4fda-b82f-c552fb4ce33a None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:10.892945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b941-49fb-4fda-b82f-c552fb4ce33a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:10.892945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996b941-49fb-4fda-b82f-c552fb4ce33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:10.903907 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:10.910608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-2996b941-49fb-4fda-b82f-c552fb4ce33a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:10.911957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2996b941-49fb-4fda-b82f-c552fb4ce33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:10.958136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:10.987918 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 465/917] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:10.988765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996b941-49fb-4fda-b82f-c552fb4ce33a None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:11.017542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd0652-3bc4-4a4b-8d13-6f16e84f92dc None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:11.060730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8b03a-bf00-42cb-ab32-04e5d0e341f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:11.061142 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b03a-bf00-42cb-ab32-04e5d0e341f8 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:11.061417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b03a-bf00-42cb-ab32-04e5d0e341f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:11.061714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b03a-bf00-42cb-ab32-04e5d0e341f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:11.062462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8b03a-bf00-42cb-ab32-04e5d0e341f8 None admin] RBAC: Adding query filter params (role.id=0e6b112ed98e4963b1a301ab45684b48, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=de4d78d267af4fe0a6aefed603b0343f) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:11.062783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8b03a-bf00-42cb-ab32-04e5d0e341f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:11.064183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8b03a-bf00-42cb-ab32-04e5d0e341f8 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:11.070170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 453/918] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:10 2022] GET /identity/v3/role_assignments?user.id=de4d78d267af4fe0a6aefed603b0343f&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=0e6b112ed98e4963b1a301ab45684b48 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:11.071618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce46f-2f65-45b2-927f-ce16a3d8fa71 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:11.071895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce46f-2f65-45b2-927f-ce16a3d8fa71 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:11.072166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce46f-2f65-45b2-927f-ce16a3d8fa71 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:11.073555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 454/919] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:11.084411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad337971-9964-4811-8ff5-05d721cd34b7 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:11.084784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad337971-9964-4811-8ff5-05d721cd34b7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:11.085128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad337971-9964-4811-8ff5-05d721cd34b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:11.105608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996b941-49fb-4fda-b82f-c552fb4ce33a None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:11.113362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ad337971-9964-4811-8ff5-05d721cd34b7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:11.115747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ad337971-9964-4811-8ff5-05d721cd34b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:11.152674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12952d-a8cf-4171-af49-78f04731d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:11.154029 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12952d-a8cf-4171-af49-78f04731d63c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:11.154785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12952d-a8cf-4171-af49-78f04731d63c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:11.155314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12952d-a8cf-4171-af49-78f04731d63c None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:11.156994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12952d-a8cf-4171-af49-78f04731d63c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:11.157591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12952d-a8cf-4171-af49-78f04731d63c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:11.160373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12952d-a8cf-4171-af49-78f04731d63c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:11.172298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 466/920] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 31 19:09:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:11.174124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12952d-a8cf-4171-af49-78f04731d63c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:11.209540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 455/921] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:11.231812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:11.267190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad337971-9964-4811-8ff5-05d721cd34b7 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:11.272405 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:11.308209 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12952d-a8cf-4171-af49-78f04731d63c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:11.351232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac7a41-1ad4-49cc-8518-679a309e78f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:11.351907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7a41-1ad4-49cc-8518-679a309e78f2 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:11.352298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7a41-1ad4-49cc-8518-679a309e78f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:11.352645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7a41-1ad4-49cc-8518-679a309e78f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:11.353394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac7a41-1ad4-49cc-8518-679a309e78f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:11.354903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac7a41-1ad4-49cc-8518-679a309e78f2 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:11.401699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad337971-9964-4811-8ff5-05d721cd34b7 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:11.423921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 467/922] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:09:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:11.459814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a351fc-b5f2-41a1-a5a2-7ff98706d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:11.460524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a351fc-b5f2-41a1-a5a2-7ff98706d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:11.460867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a351fc-b5f2-41a1-a5a2-7ff98706d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:11.461147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a351fc-b5f2-41a1-a5a2-7ff98706d8c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:11.461925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a351fc-b5f2-41a1-a5a2-7ff98706d8c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:11.463399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a351fc-b5f2-41a1-a5a2-7ff98706d8c1 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-02a351fc-b5f2-41a1-a5a2-7ff98706d8c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:11.474220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:11.475213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:09:11.476082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:11.480159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 456/923] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 31 19:09:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:11.482450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac7a41-1ad4-49cc-8518-679a309e78f2 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:11.492027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a351fc-b5f2-41a1-a5a2-7ff98706d8c1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:11.580220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:11.615948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:11.624527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac7a41-1ad4-49cc-8518-679a309e78f2 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:11.635987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a351fc-b5f2-41a1-a5a2-7ff98706d8c1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:11.673195 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24509d3-4a06-4dc9-a7ca-5e2c23f13adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:11.675560 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24509d3-4a06-4dc9-a7ca-5e2c23f13adb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:11.676174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24509d3-4a06-4dc9-a7ca-5e2c23f13adb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:11.676777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24509d3-4a06-4dc9-a7ca-5e2c23f13adb None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:11.677924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24509d3-4a06-4dc9-a7ca-5e2c23f13adb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:11.678439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24509d3-4a06-4dc9-a7ca-5e2c23f13adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:11.680681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24509d3-4a06-4dc9-a7ca-5e2c23f13adb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:11.686020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 468/924] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:11.689393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51601d-11b6-4bb2-9ada-4d54a27a8fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:11.690105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51601d-11b6-4bb2-9ada-4d54a27a8fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:11.690382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51601d-11b6-4bb2-9ada-4d54a27a8fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:11.690653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51601d-11b6-4bb2-9ada-4d54a27a8fa4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:11.691248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51601d-11b6-4bb2-9ada-4d54a27a8fa4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:11.692308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24509d3-4a06-4dc9-a7ca-5e2c23f13adb None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:11.692616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51601d-11b6-4bb2-9ada-4d54a27a8fa4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-7b51601d-11b6-4bb2-9ada-4d54a27a8fa4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:11.702766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:11.703849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:11.704677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 457/925] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:11.712839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51601d-11b6-4bb2-9ada-4d54a27a8fa4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:11.819504 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24509d3-4a06-4dc9-a7ca-5e2c23f13adb None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:11.855782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51601d-11b6-4bb2-9ada-4d54a27a8fa4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:11.863118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5562db6-33df-4a3c-8cfb-de4556544622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:11.863738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5562db6-33df-4a3c-8cfb-de4556544622 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:11.864013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5562db6-33df-4a3c-8cfb-de4556544622 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:11.864289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5562db6-33df-4a3c-8cfb-de4556544622 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:11.864932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5562db6-33df-4a3c-8cfb-de4556544622 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:11.865238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5562db6-33df-4a3c-8cfb-de4556544622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:11.866769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5562db6-33df-4a3c-8cfb-de4556544622 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:11.874331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 469/926] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:11.879750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5562db6-33df-4a3c-8cfb-de4556544622 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:11.891787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:11.903057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d0382-263b-4ae9-9a95-452e2ca5446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:11.907011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d0382-263b-4ae9-9a95-452e2ca5446c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:11.907011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d0382-263b-4ae9-9a95-452e2ca5446c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:11.907011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d0382-263b-4ae9-9a95-452e2ca5446c None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:11.907011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d0382-263b-4ae9-9a95-452e2ca5446c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:11.907011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d0382-263b-4ae9-9a95-452e2ca5446c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:11.907746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d0382-263b-4ae9-9a95-452e2ca5446c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:11.913788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:11.920534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 458/927] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 31 19:09:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:11.922368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d0382-263b-4ae9-9a95-452e2ca5446c None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:12.020240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5562db6-33df-4a3c-8cfb-de4556544622 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:12.057037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d0382-263b-4ae9-9a95-452e2ca5446c None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:12.067251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f060a4-c062-4cd5-b35e-978b9e95eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:12.067877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f060a4-c062-4cd5-b35e-978b9e95eef6 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:12.068160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f060a4-c062-4cd5-b35e-978b9e95eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:12.068436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f060a4-c062-4cd5-b35e-978b9e95eef6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:12.069724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f060a4-c062-4cd5-b35e-978b9e95eef6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:12.070573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f060a4-c062-4cd5-b35e-978b9e95eef6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:12.104262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e332b0b-aeea-4cbf-940e-aad4d225319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:12.104994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e332b0b-aeea-4cbf-940e-aad4d225319a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:12.105338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e332b0b-aeea-4cbf-940e-aad4d225319a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:12.105698 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e332b0b-aeea-4cbf-940e-aad4d225319a None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:12.106408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e332b0b-aeea-4cbf-940e-aad4d225319a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:12.106793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e332b0b-aeea-4cbf-940e-aad4d225319a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:12.108227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e332b0b-aeea-4cbf-940e-aad4d225319a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:12.113813 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 459/928] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 31 19:09:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:12.119487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e332b0b-aeea-4cbf-940e-aad4d225319a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:12.188220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:12.205248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 470/929] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:09:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:09:12.249856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e332b0b-aeea-4cbf-940e-aad4d225319a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:12.297175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc24cf-58c5-4cac-b095-e59e6328174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:12.297888 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc24cf-58c5-4cac-b095-e59e6328174a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:12.298168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc24cf-58c5-4cac-b095-e59e6328174a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:12.298489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc24cf-58c5-4cac-b095-e59e6328174a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:12.299211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc24cf-58c5-4cac-b095-e59e6328174a None admin] RBAC: Adding query filter params (interface=public, service_id=38fcc7c585914bf89448c5edc418e4a6, region_id=RegionOne) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:12.299594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc24cf-58c5-4cac-b095-e59e6328174a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:12.300985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc24cf-58c5-4cac-b095-e59e6328174a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:12.307543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 460/930] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 31 19:09:12 2022] GET /identity/v3/endpoints?service_id=38fcc7c585914bf89448c5edc418e4a6&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:12.313371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f060a4-c062-4cd5-b35e-978b9e95eef6 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:12.403885 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:12.432415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f060a4-c062-4cd5-b35e-978b9e95eef6 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:12.473439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b4ca4-ce92-4c70-afd3-1cf8308cac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:12.474090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b4ca4-ce92-4c70-afd3-1cf8308cac3b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:12.474373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b4ca4-ce92-4c70-afd3-1cf8308cac3b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:12.474643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b4ca4-ce92-4c70-afd3-1cf8308cac3b None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:12.475253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b4ca4-ce92-4c70-afd3-1cf8308cac3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:12.476692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b4ca4-ce92-4c70-afd3-1cf8308cac3b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:12.483654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 471/931] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 31 19:09:12 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:09:13.063934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03cee5-ba3a-49c4-9a99-46452069b178 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.064453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03cee5-ba3a-49c4-9a99-46452069b178 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.064453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03cee5-ba3a-49c4-9a99-46452069b178 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.066704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 461/932] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:13.072394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff0fbf-9d93-424a-ace6-6c087bfb0ad5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.072815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff0fbf-9d93-424a-ace6-6c087bfb0ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.073042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff0fbf-9d93-424a-ace6-6c087bfb0ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.092306 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e7ff0fbf-9d93-424a-ace6-6c087bfb0ad5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:13.094145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e7ff0fbf-9d93-424a-ace6-6c087bfb0ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:13.168211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 472/933] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:13.434004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03cee5-ba3a-49c4-9a99-46452069b178 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:13.489385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a1682-30bf-422b-8204-2acb1426df91 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.489695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a1682-30bf-422b-8204-2acb1426df91 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.489989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a1682-30bf-422b-8204-2acb1426df91 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.491648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 473/934] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:13.497051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd37c-0ff4-442b-a5d3-bf70c2439e15 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.497353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd37c-0ff4-442b-a5d3-bf70c2439e15 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.497600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd37c-0ff4-442b-a5d3-bf70c2439e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.516160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-f56dd37c-0ff4-442b-a5d3-bf70c2439e15 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:13.517384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f56dd37c-0ff4-442b-a5d3-bf70c2439e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:13.581619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03cee5-ba3a-49c4-9a99-46452069b178 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:13.598745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 474/935] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:13.614623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:13.634310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec79e1d-4d67-4be0-bc32-3b99387c343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:13.634946 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec79e1d-4d67-4be0-bc32-3b99387c343c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.635224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec79e1d-4d67-4be0-bc32-3b99387c343c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.635492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec79e1d-4d67-4be0-bc32-3b99387c343c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.647504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec79e1d-4d67-4be0-bc32-3b99387c343c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-6ec79e1d-4d67-4be0-bc32-3b99387c343c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:13.652366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:13.653298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:13.654596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 462/936] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 31 19:09:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:13.660557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dd37c-0ff4-442b-a5d3-bf70c2439e15 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:13.663131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:13.766836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dd37c-0ff4-442b-a5d3-bf70c2439e15 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:13.802154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198df726-d8de-4b24-9261-cd608e9609ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:13.802761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198df726-d8de-4b24-9261-cd608e9609ca None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.803040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198df726-d8de-4b24-9261-cd608e9609ca None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.803316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198df726-d8de-4b24-9261-cd608e9609ca None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.803979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198df726-d8de-4b24-9261-cd608e9609ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:13.804279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198df726-d8de-4b24-9261-cd608e9609ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:13.805632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198df726-d8de-4b24-9261-cd608e9609ca None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:13.814317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 475/937] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 31 19:09:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:13.821273 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec79e1d-4d67-4be0-bc32-3b99387c343c None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:13.871813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198df726-d8de-4b24-9261-cd608e9609ca None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:13.943233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec79e1d-4d67-4be0-bc32-3b99387c343c None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:13.943680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:13.991026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c400a-47c0-42e0-b1c3-480650b93947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:13.993707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c400a-47c0-42e0-b1c3-480650b93947 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:13.993707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c400a-47c0-42e0-b1c3-480650b93947 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:13.993707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c400a-47c0-42e0-b1c3-480650b93947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:13.995903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198df726-d8de-4b24-9261-cd608e9609ca None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:14.008063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c400a-47c0-42e0-b1c3-480650b93947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:14.010120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c400a-47c0-42e0-b1c3-480650b93947 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-ff4c400a-47c0-42e0-b1c3-480650b93947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:14.029292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:14.030312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:14.031175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:14.031175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:14.031175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:14.031342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 463/938] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:14.038384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c400a-47c0-42e0-b1c3-480650b93947 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:14.042422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:14.043092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.043373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.043647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.044325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:14.045858 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:14.048878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: WARNING keystone.server.flask.common [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 19:09:14.079035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:14.099883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.sql.core [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 19:09:14.099883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 19:09:14.099883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [parameters: {'id': '92d37a61c3304375a12a3de1e0f7a13e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 19:09:14.099883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81728) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 92d37a61c3304375a12a3de1e0f7a13e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 92d37a61c3304375a12a3de1e0f7a13e. Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:09:14.109582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application result.read() Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 19:09:14.124980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application yield resource Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise self.value Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application session.commit() Aug 31 19:09:14.126160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self.session.flush() Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application compat.raise_( Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 19:09:14.127068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 19:09:14.129157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application result.read() Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:09:14.130161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [parameters: {'id': '92d37a61c3304375a12a3de1e0f7a13e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:14.131200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:14.132139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 92d37a61c3304375a12a3de1e0f7a13e. Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 476/939] 10.222.0.42 () {60 vars in 1140 bytes} [Wed Aug 31 19:09:13 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:14.133213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:14.177268 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c400a-47c0-42e0-b1c3-480650b93947 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:14.214590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9ab9-1307-437b-9a47-e5867ed9eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:14.215475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9ab9-1307-437b-9a47-e5867ed9eefe None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.215900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9ab9-1307-437b-9a47-e5867ed9eefe None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.216366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9ab9-1307-437b-9a47-e5867ed9eefe None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.217220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae9ab9-1307-437b-9a47-e5867ed9eefe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:14.217802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae9ab9-1307-437b-9a47-e5867ed9eefe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:14.219385 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae9ab9-1307-437b-9a47-e5867ed9eefe None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:14.233119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 464/940] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:14.234304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf4d8-de03-4fa8-ba24-2af5a99acece None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:14.238856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9ab9-1307-437b-9a47-e5867ed9eefe None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:14.256603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:14.271134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789c9f8-e2a8-4930-9b02-eee14ed5266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:14.274614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789c9f8-e2a8-4930-9b02-eee14ed5266a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.274614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789c9f8-e2a8-4930-9b02-eee14ed5266a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.274614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789c9f8-e2a8-4930-9b02-eee14ed5266a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.280256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789c9f8-e2a8-4930-9b02-eee14ed5266a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:14.281602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789c9f8-e2a8-4930-9b02-eee14ed5266a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-2789c9f8-e2a8-4930-9b02-eee14ed5266a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:14.294479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:14.295409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:14.296282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:14.296282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:14.296282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:14.296282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:14.296282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:14.296282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:14.296282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:14.296282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:14.301255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 477/941] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:14.302238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789c9f8-e2a8-4930-9b02-eee14ed5266a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:14.342444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:14.356015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9ab9-1307-437b-9a47-e5867ed9eefe None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:14.394527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8623d-904a-40bf-9a7e-21d8d53cc150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:14.395288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8623d-904a-40bf-9a7e-21d8d53cc150 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.395571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8623d-904a-40bf-9a7e-21d8d53cc150 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.395842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8623d-904a-40bf-9a7e-21d8d53cc150 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.404050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8623d-904a-40bf-9a7e-21d8d53cc150 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:14.405492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8623d-904a-40bf-9a7e-21d8d53cc150 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:14.412400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789c9f8-e2a8-4930-9b02-eee14ed5266a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-53a8623d-904a-40bf-9a7e-21d8d53cc150 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:14.417859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:14.418819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:14.419760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 465/942] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 31 19:09:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:14.421027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0fcb-e0a9-4b61-81d9-ed700efbabc7 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.421027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0fcb-e0a9-4b61-81d9-ed700efbabc7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.421027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0fcb-e0a9-4b61-81d9-ed700efbabc7 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.422464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 466/943] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:14.427714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0fcb-e0a9-4b61-81d9-ed700efbabc7 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:14.451766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318c2b-025b-4701-98ce-bd708b107b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:14.452384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318c2b-025b-4701-98ce-bd708b107b08 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.452677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318c2b-025b-4701-98ce-bd708b107b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.452945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318c2b-025b-4701-98ce-bd708b107b08 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.453612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318c2b-025b-4701-98ce-bd708b107b08 None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:14.454144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318c2b-025b-4701-98ce-bd708b107b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:14.455418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318c2b-025b-4701-98ce-bd708b107b08 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:14.485713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 478/944] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:09:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:14.485713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c2a0-6571-4d40-b7f5-f34c05cc4054 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.485713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c2a0-6571-4d40-b7f5-f34c05cc4054 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.485713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c2a0-6571-4d40-b7f5-f34c05cc4054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.509397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b320c2a0-6571-4d40-b7f5-f34c05cc4054 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:14.512097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b320c2a0-6571-4d40-b7f5-f34c05cc4054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:14.556570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:14.563229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0fcb-e0a9-4b61-81d9-ed700efbabc7 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:14.601849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 479/945] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:14.603936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be907a2-d27a-4f15-b079-939e3181b87a None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.604104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b09a6-0cd9-4629-822d-36f28089cea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:14.604723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be907a2-d27a-4f15-b079-939e3181b87a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.604842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b09a6-0cd9-4629-822d-36f28089cea3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.605138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b09a6-0cd9-4629-822d-36f28089cea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.605492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b09a6-0cd9-4629-822d-36f28089cea3 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.605608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be907a2-d27a-4f15-b079-939e3181b87a None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.606584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b09a6-0cd9-4629-822d-36f28089cea3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:14.606977 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b09a6-0cd9-4629-822d-36f28089cea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:14.608006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 480/946] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:14.610620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b09a6-0cd9-4629-822d-36f28089cea3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:14.614890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289ae9c-3b17-4cb5-bb5a-97d552eb54b8 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.615182 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289ae9c-3b17-4cb5-bb5a-97d552eb54b8 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.615457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289ae9c-3b17-4cb5-bb5a-97d552eb54b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.638078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 467/947] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 31 19:09:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:14.638824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-7289ae9c-3b17-4cb5-bb5a-97d552eb54b8 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:14.640055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7289ae9c-3b17-4cb5-bb5a-97d552eb54b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:14.644092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b09a6-0cd9-4629-822d-36f28089cea3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:14.656061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:14.733960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 481/948] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:14.773792 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b09a6-0cd9-4629-822d-36f28089cea3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:14.809973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cb478-706d-4c7a-9c27-7a50869a8d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:14.810529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cb478-706d-4c7a-9c27-7a50869a8d62 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:14.810810 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cb478-706d-4c7a-9c27-7a50869a8d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:14.811085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cb478-706d-4c7a-9c27-7a50869a8d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:14.822130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cb478-706d-4c7a-9c27-7a50869a8d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:14.823722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cb478-706d-4c7a-9c27-7a50869a8d62 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-ef0cb478-706d-4c7a-9c27-7a50869a8d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:14.839003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:14.840001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:14.840888 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:14.840888 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:14.840888 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:14.840888 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 468/949] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:14.846804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289ae9c-3b17-4cb5-bb5a-97d552eb54b8 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:14.879031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cb478-706d-4c7a-9c27-7a50869a8d62 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:14.957063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:14.959610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:14.962625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289ae9c-3b17-4cb5-bb5a-97d552eb54b8 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.007220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cb478-706d-4c7a-9c27-7a50869a8d62 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.009935 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f706a-2f78-4209-84bd-470787beec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.011629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f706a-2f78-4209-84bd-470787beec53 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.011917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f706a-2f78-4209-84bd-470787beec53 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.012217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f706a-2f78-4209-84bd-470787beec53 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.013008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f706a-2f78-4209-84bd-470787beec53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:15.013316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f706a-2f78-4209-84bd-470787beec53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.014739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f706a-2f78-4209-84bd-470787beec53 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:15.032238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 482/950] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:15.033118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f706a-2f78-4209-84bd-470787beec53 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:15.056371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71249b-f191-4a2f-8140-a39c57c7a404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.057030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71249b-f191-4a2f-8140-a39c57c7a404 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.057357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71249b-f191-4a2f-8140-a39c57c7a404 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.057643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71249b-f191-4a2f-8140-a39c57c7a404 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.058285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71249b-f191-4a2f-8140-a39c57c7a404 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.059776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71249b-f191-4a2f-8140-a39c57c7a404 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-9e71249b-f191-4a2f-8140-a39c57c7a404 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:15.070045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:15.071330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:15.072151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 469/951] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:15.073734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71249b-f191-4a2f-8140-a39c57c7a404 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:15.161975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f706a-2f78-4209-84bd-470787beec53 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.183735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71249b-f191-4a2f-8140-a39c57c7a404 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.198153 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fa9a3-ae63-4a9f-abbb-c28459ff1edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.198781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fa9a3-ae63-4a9f-abbb-c28459ff1edd None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.199069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fa9a3-ae63-4a9f-abbb-c28459ff1edd None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.199357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fa9a3-ae63-4a9f-abbb-c28459ff1edd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.199948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fa9a3-ae63-4a9f-abbb-c28459ff1edd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.201327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fa9a3-ae63-4a9f-abbb-c28459ff1edd None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:15.210816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-875fa9a3-ae63-4a9f-abbb-c28459ff1edd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:15.214741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:15.215851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:15.216729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 483/952] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:15.222371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fa9a3-ae63-4a9f-abbb-c28459ff1edd None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:15.227135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcd4c3-c672-4c0d-90ba-867086b68cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.227135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd4c3-c672-4c0d-90ba-867086b68cac None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.227135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd4c3-c672-4c0d-90ba-867086b68cac None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.227475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd4c3-c672-4c0d-90ba-867086b68cac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.235029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcd4c3-c672-4c0d-90ba-867086b68cac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.236466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcd4c3-c672-4c0d-90ba-867086b68cac None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-0cfcd4c3-c672-4c0d-90ba-867086b68cac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:15.248429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:15.249549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:15.250665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:15.250665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:15.250665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:15.250665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:15.250665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:15.250665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:15.250665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:15.250665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:15.252995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 470/953] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:15.255211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcd4c3-c672-4c0d-90ba-867086b68cac None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:15.259039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:15.341298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fa9a3-ae63-4a9f-abbb-c28459ff1edd None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.374665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcd4c3-c672-4c0d-90ba-867086b68cac None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.386757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a21f45-194a-4c8a-b16d-2a134a8a2cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.387479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a21f45-194a-4c8a-b16d-2a134a8a2cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.387761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a21f45-194a-4c8a-b16d-2a134a8a2cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.388025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a21f45-194a-4c8a-b16d-2a134a8a2cd2 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.388665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a21f45-194a-4c8a-b16d-2a134a8a2cd2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:15.388964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a21f45-194a-4c8a-b16d-2a134a8a2cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.390464 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a21f45-194a-4c8a-b16d-2a134a8a2cd2 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:15.396569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 484/954] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:09:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:15.402067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a21f45-194a-4c8a-b16d-2a134a8a2cd2 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:15.420289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47117319-4274-40d6-9c19-72648d727178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.421506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47117319-4274-40d6-9c19-72648d727178 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.422317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47117319-4274-40d6-9c19-72648d727178 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.422797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47117319-4274-40d6-9c19-72648d727178 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.423642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47117319-4274-40d6-9c19-72648d727178 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:15.424266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47117319-4274-40d6-9c19-72648d727178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.426727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47117319-4274-40d6-9c19-72648d727178 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:15.436461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 471/955] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 31 19:09:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:15.439797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47117319-4274-40d6-9c19-72648d727178 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:15.498943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:15.501322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:15.512115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a21f45-194a-4c8a-b16d-2a134a8a2cd2 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.559070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d455921-7f55-4c17-bae0-ebfe42eabd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.560067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d455921-7f55-4c17-bae0-ebfe42eabd67 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.560421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d455921-7f55-4c17-bae0-ebfe42eabd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.560800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d455921-7f55-4c17-bae0-ebfe42eabd67 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.561494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d455921-7f55-4c17-bae0-ebfe42eabd67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:15.561835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d455921-7f55-4c17-bae0-ebfe42eabd67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.563272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d455921-7f55-4c17-bae0-ebfe42eabd67 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:15.573389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47117319-4274-40d6-9c19-72648d727178 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.576324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 485/956] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:15.577010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d455921-7f55-4c17-bae0-ebfe42eabd67 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:15.620785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8bdfa-bc14-4737-a78c-cbe251e642ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.621315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8bdfa-bc14-4737-a78c-cbe251e642ae None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.621621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8bdfa-bc14-4737-a78c-cbe251e642ae None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.621933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8bdfa-bc14-4737-a78c-cbe251e642ae None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.622578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8bdfa-bc14-4737-a78c-cbe251e642ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:15.622886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8bdfa-bc14-4737-a78c-cbe251e642ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.624339 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8bdfa-bc14-4737-a78c-cbe251e642ae None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:15.640372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 472/957] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:09:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:15.641941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8bdfa-bc14-4737-a78c-cbe251e642ae None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:15.699854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d455921-7f55-4c17-bae0-ebfe42eabd67 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.747882 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a66db-1d53-4e57-87a4-cc459a42bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.748981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a66db-1d53-4e57-87a4-cc459a42bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.749292 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a66db-1d53-4e57-87a4-cc459a42bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.749602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a66db-1d53-4e57-87a4-cc459a42bdf7 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.750297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a66db-1d53-4e57-87a4-cc459a42bdf7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:15.750608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a66db-1d53-4e57-87a4-cc459a42bdf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.752004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a66db-1d53-4e57-87a4-cc459a42bdf7 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:15.762061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 486/958] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 31 19:09:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:15.767984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a66db-1d53-4e57-87a4-cc459a42bdf7 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:15.774934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8bdfa-bc14-4737-a78c-cbe251e642ae None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.789379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:15.790782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:15.832283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956c444-c98d-4d5f-b07b-cb8fc596fa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.832963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956c444-c98d-4d5f-b07b-cb8fc596fa24 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.834423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956c444-c98d-4d5f-b07b-cb8fc596fa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.834536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956c444-c98d-4d5f-b07b-cb8fc596fa24 None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/de4d78d267af4fe0a6aefed603b0343f/roles/0e6b112ed98e4963b1a301ab45684b48` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.837483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956c444-c98d-4d5f-b07b-cb8fc596fa24 None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=de4d78d267af4fe0a6aefed603b0343f, role_id=0e6b112ed98e4963b1a301ab45684b48)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.839037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956c444-c98d-4d5f-b07b-cb8fc596fa24 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:15.903899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a66db-1d53-4e57-87a4-cc459a42bdf7 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:15.926041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 473/959] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:09:15 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/de4d78d267af4fe0a6aefed603b0343f/roles/0e6b112ed98e4963b1a301ab45684b48 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:09:15.954332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7829d-9ef6-46bb-a298-f674bec68f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:15.955020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7829d-9ef6-46bb-a298-f674bec68f55 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:15.955496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7829d-9ef6-46bb-a298-f674bec68f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:15.955913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7829d-9ef6-46bb-a298-f674bec68f55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:15.956617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7829d-9ef6-46bb-a298-f674bec68f55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:15.958334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7829d-9ef6-46bb-a298-f674bec68f55 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:16.046563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 487/960] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:09:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:09:16.587517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f586e-4c9c-4701-95e9-f13139a0740d None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:16.588070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f586e-4c9c-4701-95e9-f13139a0740d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:16.588070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f586e-4c9c-4701-95e9-f13139a0740d None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:16.589561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 474/961] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:16.595140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e5a7-135f-448a-9c0d-fd20715b5764 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:16.595604 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e5a7-135f-448a-9c0d-fd20715b5764 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:16.595703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e5a7-135f-448a-9c0d-fd20715b5764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:16.615271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-8bc4e5a7-135f-448a-9c0d-fd20715b5764 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:16.616488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8bc4e5a7-135f-448a-9c0d-fd20715b5764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:16.685365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:16.698010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 488/962] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:16.970732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f586e-4c9c-4701-95e9-f13139a0740d None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:17.088281 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f586e-4c9c-4701-95e9-f13139a0740d None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:17.129368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:17.130042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:17.130333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:17.130610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:17.131278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:17.132759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:17.135431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WARNING keystone.server.flask.common [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 19:09:17.179015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.sql.core [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 19:09:17.179015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 19:09:17.179015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [parameters: {'user_id': '4c86e1593c1b4c57ba5a0d71bc41c022', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 19:09:17.179015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81727) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application result.read() Aug 31 19:09:17.197067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:09:17.199209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application yield resource Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise self.value Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application session.commit() Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 19:09:17.201593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self.session.flush() Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application compat.raise_( Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 19:09:17.203732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:09:17.209552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application result.read() Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:09:17.212766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [parameters: {'user_id': '4c86e1593c1b4c57ba5a0d71bc41c022', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:17.214850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 19:09:17.219021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 19:09:17.221725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 19:09:17.221725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 19:09:17.221725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 19:09:17.221725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 19:09:17.221725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 19:09:17.221725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:17.221725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 475/963] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 31 19:09:16 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:17.222665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4e5a7-135f-448a-9c0d-fd20715b5764 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:17.322556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4e5a7-135f-448a-9c0d-fd20715b5764 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:17.360241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8ed5e-4984-4802-9efd-083ed34bcf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:17.360899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ed5e-4984-4802-9efd-083ed34bcf60 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:17.361183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ed5e-4984-4802-9efd-083ed34bcf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:17.361462 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ed5e-4984-4802-9efd-083ed34bcf60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:17.369958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8ed5e-4984-4802-9efd-083ed34bcf60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:17.371417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8ed5e-4984-4802-9efd-083ed34bcf60 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-78b8ed5e-4984-4802-9efd-083ed34bcf60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:17.384213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:17.385223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:17.386207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 489/964] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:17.391843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:17.427360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:17.504357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cda0ea-e72f-4426-aa31-d2c83bce0265 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:17.541514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac4c25-e17d-434a-9605-ed74fed051cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:17.542202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac4c25-e17d-434a-9605-ed74fed051cf None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:17.542485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac4c25-e17d-434a-9605-ed74fed051cf None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:17.542762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac4c25-e17d-434a-9605-ed74fed051cf None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:17.543480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac4c25-e17d-434a-9605-ed74fed051cf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:17.543792 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac4c25-e17d-434a-9605-ed74fed051cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:17.545447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac4c25-e17d-434a-9605-ed74fed051cf None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:17.593863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 476/965] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 31 19:09:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:17.690152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18177c86-2604-4ddc-82be-c499846ba077 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:17.690821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18177c86-2604-4ddc-82be-c499846ba077 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:17.690821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18177c86-2604-4ddc-82be-c499846ba077 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:17.692361 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 490/966] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:17.698424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115553b8-1c51-4018-b402-06b2ec86b854 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:17.698755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115553b8-1c51-4018-b402-06b2ec86b854 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:17.698969 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115553b8-1c51-4018-b402-06b2ec86b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:17.719640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-115553b8-1c51-4018-b402-06b2ec86b854 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:17.721791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-115553b8-1c51-4018-b402-06b2ec86b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:17.806695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 477/967] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:17.986905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd59fd-f642-4f73-a4ef-9840d1fc6bc9 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:17.991623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd59fd-f642-4f73-a4ef-9840d1fc6bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:17.991623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd59fd-f642-4f73-a4ef-9840d1fc6bc9 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:17.991623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 491/968] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:17.994530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99274bd9-919a-47bc-9d92-a21d5822aa31 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:17.994833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99274bd9-919a-47bc-9d92-a21d5822aa31 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:17.995115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99274bd9-919a-47bc-9d92-a21d5822aa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.013723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-99274bd9-919a-47bc-9d92-a21d5822aa31 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:18.014924 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-99274bd9-919a-47bc-9d92-a21d5822aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:18.031733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:18.087261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd59fd-f642-4f73-a4ef-9840d1fc6bc9 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:18.098166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 478/969] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:18.102566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b10cbf-1c68-4a6c-8328-62b886b22201 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:18.102848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b10cbf-1c68-4a6c-8328-62b886b22201 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:18.103122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b10cbf-1c68-4a6c-8328-62b886b22201 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.104460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 479/970] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:18.110368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbafa5-ed59-421a-b23f-e0c66c6c248d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:18.110628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbafa5-ed59-421a-b23f-e0c66c6c248d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:18.110872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbafa5-ed59-421a-b23f-e0c66c6c248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.129498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-98dbafa5-ed59-421a-b23f-e0c66c6c248d None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:18.130785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-98dbafa5-ed59-421a-b23f-e0c66c6c248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:18.155785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:18.215184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd59fd-f642-4f73-a4ef-9840d1fc6bc9 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:18.225602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 480/971] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:18.269610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38baf7-f2bf-4bc7-b3f7-8dd70ebf069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:18.270262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38baf7-f2bf-4bc7-b3f7-8dd70ebf069b None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:18.270543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38baf7-f2bf-4bc7-b3f7-8dd70ebf069b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:18.270819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38baf7-f2bf-4bc7-b3f7-8dd70ebf069b None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.271487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38baf7-f2bf-4bc7-b3f7-8dd70ebf069b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:18.272872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38baf7-f2bf-4bc7-b3f7-8dd70ebf069b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:18.362236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbafa5-ed59-421a-b23f-e0c66c6c248d None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:18.363385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 492/972] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:09:18 2022] POST /identity/v3/services => generated 242 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:09:18.468372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:18.490300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbafa5-ed59-421a-b23f-e0c66c6c248d None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:18.506822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38baf7-f2bf-4bc7-b3f7-8dd70ebf069b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:18.551904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c42e7-7b4d-4038-8297-21d3d4ea156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:18.553393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c42e7-7b4d-4038-8297-21d3d4ea156a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:18.554512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c42e7-7b4d-4038-8297-21d3d4ea156a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:18.555388 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c42e7-7b4d-4038-8297-21d3d4ea156a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.575449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c42e7-7b4d-4038-8297-21d3d4ea156a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-da4c42e7-7b4d-4038-8297-21d3d4ea156a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:18.581712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:18.582712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:18.583528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:18.590819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 481/973] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 31 19:09:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:18.591987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c42e7-7b4d-4038-8297-21d3d4ea156a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:18.648757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38baf7-f2bf-4bc7-b3f7-8dd70ebf069b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:18.664943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:18.686554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472295f-a06b-4021-883e-3d0a05cfd258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:18.687203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472295f-a06b-4021-883e-3d0a05cfd258 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:18.687488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472295f-a06b-4021-883e-3d0a05cfd258 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:18.687762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472295f-a06b-4021-883e-3d0a05cfd258 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.688364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472295f-a06b-4021-883e-3d0a05cfd258 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:18.689788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472295f-a06b-4021-883e-3d0a05cfd258 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-4472295f-a06b-4021-883e-3d0a05cfd258 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:18.699785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:18.702276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:18.703601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 493/974] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:18.706911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472295f-a06b-4021-883e-3d0a05cfd258 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:18.716021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c42e7-7b4d-4038-8297-21d3d4ea156a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:18.753882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c4f1f-6556-4750-997d-452ca73ca965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:18.754530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c4f1f-6556-4750-997d-452ca73ca965 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:18.754956 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c4f1f-6556-4750-997d-452ca73ca965 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:18.755069 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c4f1f-6556-4750-997d-452ca73ca965 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.755749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c4f1f-6556-4750-997d-452ca73ca965 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:18.756057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c4f1f-6556-4750-997d-452ca73ca965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:18.757446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c4f1f-6556-4750-997d-452ca73ca965 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:18.759952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:18.772995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 482/975] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 31 19:09:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:18.774180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c4f1f-6556-4750-997d-452ca73ca965 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:18.830029 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472295f-a06b-4021-883e-3d0a05cfd258 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:18.875337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc44d2-c1d8-4e5b-95b9-16a3c11c4827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:18.876558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc44d2-c1d8-4e5b-95b9-16a3c11c4827 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:18.877017 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc44d2-c1d8-4e5b-95b9-16a3c11c4827 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:18.877476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc44d2-c1d8-4e5b-95b9-16a3c11c4827 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.878598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc44d2-c1d8-4e5b-95b9-16a3c11c4827 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:18.879110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc44d2-c1d8-4e5b-95b9-16a3c11c4827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:18.881809 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc44d2-c1d8-4e5b-95b9-16a3c11c4827 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:18.894085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 494/976] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 31 19:09:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:18.897367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc44d2-c1d8-4e5b-95b9-16a3c11c4827 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:18.907096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c4f1f-6556-4750-997d-452ca73ca965 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:18.956729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd3208-0703-43a3-9ba0-9d72f106ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:18.957368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd3208-0703-43a3-9ba0-9d72f106ca80 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:18.957647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd3208-0703-43a3-9ba0-9d72f106ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:18.957942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd3208-0703-43a3-9ba0-9d72f106ca80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:18.965519 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:18.970001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd3208-0703-43a3-9ba0-9d72f106ca80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:18.972059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd3208-0703-43a3-9ba0-9d72f106ca80 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-8cdd3208-0703-43a3-9ba0-9d72f106ca80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:18.987333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:18.988348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:18.989232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:18.989232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:18.989232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:18.989232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 483/977] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:18.994314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd3208-0703-43a3-9ba0-9d72f106ca80 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.030789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc44d2-c1d8-4e5b-95b9-16a3c11c4827 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.049728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:19.069535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620e90c-31be-42a9-8f4c-491a1ddfbae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.070182 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e90c-31be-42a9-8f4c-491a1ddfbae9 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.073539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e90c-31be-42a9-8f4c-491a1ddfbae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.073539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e90c-31be-42a9-8f4c-491a1ddfbae9 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.073539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620e90c-31be-42a9-8f4c-491a1ddfbae9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:19.073539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620e90c-31be-42a9-8f4c-491a1ddfbae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.073539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620e90c-31be-42a9-8f4c-491a1ddfbae9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.083812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 495/978] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 31 19:09:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:19.086011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620e90c-31be-42a9-8f4c-491a1ddfbae9 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.111325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd3208-0703-43a3-9ba0-9d72f106ca80 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.150703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da50def-222f-47dd-ba2b-598f3aa57ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.151514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da50def-222f-47dd-ba2b-598f3aa57ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.151797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da50def-222f-47dd-ba2b-598f3aa57ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.152177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da50def-222f-47dd-ba2b-598f3aa57ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.152841 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da50def-222f-47dd-ba2b-598f3aa57ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:19.153150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da50def-222f-47dd-ba2b-598f3aa57ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.154560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da50def-222f-47dd-ba2b-598f3aa57ac0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.173578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 484/979] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:19.174611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da50def-222f-47dd-ba2b-598f3aa57ac0 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.200140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620e90c-31be-42a9-8f4c-491a1ddfbae9 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.208961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:19.238132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a016430-cb07-432c-9241-0c693fa25c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.238747 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a016430-cb07-432c-9241-0c693fa25c4a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.239024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a016430-cb07-432c-9241-0c693fa25c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.239295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a016430-cb07-432c-9241-0c693fa25c4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.240004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a016430-cb07-432c-9241-0c693fa25c4a None admin] RBAC: Adding query filter params (interface=admin, service_id=38fcc7c585914bf89448c5edc418e4a6, region_id=RegionOne) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:19.240377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a016430-cb07-432c-9241-0c693fa25c4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.241763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a016430-cb07-432c-9241-0c693fa25c4a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.247626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 496/980] 10.222.0.42 () {56 vars in 1249 bytes} [Wed Aug 31 19:09:19 2022] GET /identity/v3/endpoints?service_id=38fcc7c585914bf89448c5edc418e4a6&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:19.253653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a016430-cb07-432c-9241-0c693fa25c4a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.287328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da50def-222f-47dd-ba2b-598f3aa57ac0 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.299474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:19.324886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b2746-9b93-41a5-8856-e374155d86ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.325550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b2746-9b93-41a5-8856-e374155d86ac None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.325887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b2746-9b93-41a5-8856-e374155d86ac None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.326133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b2746-9b93-41a5-8856-e374155d86ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.334938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b2746-9b93-41a5-8856-e374155d86ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.336429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b2746-9b93-41a5-8856-e374155d86ac None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-839b2746-9b93-41a5-8856-e374155d86ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:19.348332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:19.349313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:19.350306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 485/981] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 31 19:09:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:19.355394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b2746-9b93-41a5-8856-e374155d86ac None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.364257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a016430-cb07-432c-9241-0c693fa25c4a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.406267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6b511-8c5b-42d0-9c88-e22d1917e12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.406883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b511-8c5b-42d0-9c88-e22d1917e12f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.407162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b511-8c5b-42d0-9c88-e22d1917e12f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.407432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b511-8c5b-42d0-9c88-e22d1917e12f None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.408040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6b511-8c5b-42d0-9c88-e22d1917e12f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.409438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6b511-8c5b-42d0-9c88-e22d1917e12f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.425787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 497/982] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 31 19:09:19 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:09:19.487261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b2746-9b93-41a5-8856-e374155d86ac None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.527714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96203f3b-0938-45de-8ae2-4c49a4bc2b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.528343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96203f3b-0938-45de-8ae2-4c49a4bc2b92 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.528621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96203f3b-0938-45de-8ae2-4c49a4bc2b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.528896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96203f3b-0938-45de-8ae2-4c49a4bc2b92 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.529651 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96203f3b-0938-45de-8ae2-4c49a4bc2b92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:19.529987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96203f3b-0938-45de-8ae2-4c49a4bc2b92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.531463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96203f3b-0938-45de-8ae2-4c49a4bc2b92 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.555365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 486/983] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 31 19:09:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:19.561386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6b511-8c5b-42d0-9c88-e22d1917e12f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.601020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:19.680311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6b511-8c5b-42d0-9c88-e22d1917e12f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:19.719557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff01ad-2bcd-4a86-a8e5-df602c7dab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:19.720244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff01ad-2bcd-4a86-a8e5-df602c7dab6f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:19.720541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff01ad-2bcd-4a86-a8e5-df602c7dab6f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:19.720802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff01ad-2bcd-4a86-a8e5-df602c7dab6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:19.794729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff01ad-2bcd-4a86-a8e5-df602c7dab6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:19.796184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff01ad-2bcd-4a86-a8e5-df602c7dab6f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:19.839384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:19.911539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 498/984] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:19 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:19.917335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96203f3b-0938-45de-8ae2-4c49a4bc2b92 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:19.949471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:20.025649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96203f3b-0938-45de-8ae2-4c49a4bc2b92 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:20.062915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ecfd4-be4d-4b9a-bde5-5f4e3eaabffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:20.063616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ecfd4-be4d-4b9a-bde5-5f4e3eaabffe None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:20.063894 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ecfd4-be4d-4b9a-bde5-5f4e3eaabffe None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:20.064172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ecfd4-be4d-4b9a-bde5-5f4e3eaabffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:20.075348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ecfd4-be4d-4b9a-bde5-5f4e3eaabffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:20.076806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ecfd4-be4d-4b9a-bde5-5f4e3eaabffe None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-567ecfd4-be4d-4b9a-bde5-5f4e3eaabffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:20.093250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:20.094579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:20.095800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:20.095800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:20.095800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:20.098033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 487/985] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:20.100609 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff01ad-2bcd-4a86-a8e5-df602c7dab6f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:20.208134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff01ad-2bcd-4a86-a8e5-df602c7dab6f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:20.244101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6f50-0d96-4daa-9944-fe2f7de258b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:20.244714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6f50-0d96-4daa-9944-fe2f7de258b1 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:20.244997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6f50-0d96-4daa-9944-fe2f7de258b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:20.245279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6f50-0d96-4daa-9944-fe2f7de258b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:20.245959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e6f50-0d96-4daa-9944-fe2f7de258b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:20.246266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e6f50-0d96-4daa-9944-fe2f7de258b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:20.247636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e6f50-0d96-4daa-9944-fe2f7de258b1 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:20.249185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:20.261036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 499/986] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:20.267319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ecfd4-be4d-4b9a-bde5-5f4e3eaabffe None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:20.339019 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3464e4-7569-4b37-b066-627d82710193 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:20.339377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3464e4-7569-4b37-b066-627d82710193 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:20.339715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3464e4-7569-4b37-b066-627d82710193 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:20.341448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 500/987] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:20.348403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52f4e-0207-4ded-a881-7713edde1c14 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:20.348829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52f4e-0207-4ded-a881-7713edde1c14 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:20.349207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f52f4e-0207-4ded-a881-7713edde1c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:20.359987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:20.372469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b9f52f4e-0207-4ded-a881-7713edde1c14 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:20.374288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b9f52f4e-0207-4ded-a881-7713edde1c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:20.379322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ecfd4-be4d-4b9a-bde5-5f4e3eaabffe None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:20.414506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e05837-aff0-442b-b3ba-6c8c47f8f6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:20.415134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e05837-aff0-442b-b3ba-6c8c47f8f6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:20.415405 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e05837-aff0-442b-b3ba-6c8c47f8f6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:20.415678 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e05837-aff0-442b-b3ba-6c8c47f8f6c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:20.422921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e05837-aff0-442b-b3ba-6c8c47f8f6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:20.424412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e05837-aff0-442b-b3ba-6c8c47f8f6c4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-a2e05837-aff0-442b-b3ba-6c8c47f8f6c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:20.438464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:20.439563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:20.445529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:20.445529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:20.445529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:20.445529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:20.445529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:20.445529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:20.445529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:20.445529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:20.445529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 488/988] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:20.446331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e05837-aff0-442b-b3ba-6c8c47f8f6c4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:20.455054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 501/989] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:20.562432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e05837-aff0-442b-b3ba-6c8c47f8f6c4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:20.597885 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013e6e4-4416-46d7-9077-04c1639b1099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:20.598505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013e6e4-4416-46d7-9077-04c1639b1099 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:20.598774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013e6e4-4416-46d7-9077-04c1639b1099 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:20.599048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013e6e4-4416-46d7-9077-04c1639b1099 None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:20.599736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013e6e4-4416-46d7-9077-04c1639b1099 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:20.600038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013e6e4-4416-46d7-9077-04c1639b1099 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:20.601465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013e6e4-4416-46d7-9077-04c1639b1099 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:20.611491 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:20.621294 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 489/990] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:20.622622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52f4e-0207-4ded-a881-7713edde1c14 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:20.722089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013e6e4-4416-46d7-9077-04c1639b1099 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:20.735098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f52f4e-0207-4ded-a881-7713edde1c14 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:20.764044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:20.776376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab7b3-aaf8-46bb-8d2d-db0a7a5d68ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:20.777000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab7b3-aaf8-46bb-8d2d-db0a7a5d68ec None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:20.777285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab7b3-aaf8-46bb-8d2d-db0a7a5d68ec None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:20.777657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab7b3-aaf8-46bb-8d2d-db0a7a5d68ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:20.778451 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab7b3-aaf8-46bb-8d2d-db0a7a5d68ec None admin] RBAC: Adding query filter params (role.id=0e6b112ed98e4963b1a301ab45684b48, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=de4d78d267af4fe0a6aefed603b0343f) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:20.778896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab7b3-aaf8-46bb-8d2d-db0a7a5d68ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:20.780326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab7b3-aaf8-46bb-8d2d-db0a7a5d68ec None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:20.786303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 502/991] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:20 2022] GET /identity/v3/role_assignments?user.id=de4d78d267af4fe0a6aefed603b0343f&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=0e6b112ed98e4963b1a301ab45684b48 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:20.853812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013e6e4-4416-46d7-9077-04c1639b1099 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:20.898488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b03e0-3039-46f1-9408-67ed59981bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:20.899239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b03e0-3039-46f1-9408-67ed59981bbd None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:20.899591 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b03e0-3039-46f1-9408-67ed59981bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:20.900157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b03e0-3039-46f1-9408-67ed59981bbd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:20.900602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b03e0-3039-46f1-9408-67ed59981bbd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:20.902127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b03e0-3039-46f1-9408-67ed59981bbd None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-818b03e0-3039-46f1-9408-67ed59981bbd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:20.912423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:20.914874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:09:20.915947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:20.919226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 490/992] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:20.921157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab7b3-aaf8-46bb-8d2d-db0a7a5d68ec None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:21.047896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab7b3-aaf8-46bb-8d2d-db0a7a5d68ec None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:21.084927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766bf8c-d863-4af0-87d3-76f9dbbea29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:21.085457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766bf8c-d863-4af0-87d3-76f9dbbea29c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:21.085766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766bf8c-d863-4af0-87d3-76f9dbbea29c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:21.086045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766bf8c-d863-4af0-87d3-76f9dbbea29c None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:21.086817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766bf8c-d863-4af0-87d3-76f9dbbea29c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:21.087127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766bf8c-d863-4af0-87d3-76f9dbbea29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:21.088486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766bf8c-d863-4af0-87d3-76f9dbbea29c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:21.093606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 503/993] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:09:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:21.099467 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b03e0-3039-46f1-9408-67ed59981bbd None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:21.170431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:21.214359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b03e0-3039-46f1-9408-67ed59981bbd None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:21.249220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635002bd-54cb-4330-9548-8c1c9ff837e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:21.249789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635002bd-54cb-4330-9548-8c1c9ff837e0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:21.250072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635002bd-54cb-4330-9548-8c1c9ff837e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:21.250349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635002bd-54cb-4330-9548-8c1c9ff837e0 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:21.250987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635002bd-54cb-4330-9548-8c1c9ff837e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:21.251286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635002bd-54cb-4330-9548-8c1c9ff837e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:21.253197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635002bd-54cb-4330-9548-8c1c9ff837e0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:21.258612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 491/994] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:09:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:21.264567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766bf8c-d863-4af0-87d3-76f9dbbea29c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:21.323004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:21.374803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766bf8c-d863-4af0-87d3-76f9dbbea29c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:21.382334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307541b2-3c65-4025-983e-1c17b45e4fb1 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:21.382806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307541b2-3c65-4025-983e-1c17b45e4fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:21.382975 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307541b2-3c65-4025-983e-1c17b45e4fb1 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:21.384473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 492/995] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:21.389606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe74a0-1715-491a-8d30-c4bad884d96f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:21.389898 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe74a0-1715-491a-8d30-c4bad884d96f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:21.390329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe74a0-1715-491a-8d30-c4bad884d96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:21.410346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-fffe74a0-1715-491a-8d30-c4bad884d96f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:21.411557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fffe74a0-1715-491a-8d30-c4bad884d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:21.413707 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddb414-1de8-42b1-8ea0-07d7ed72e15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:21.414555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddb414-1de8-42b1-8ea0-07d7ed72e15e None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:21.414836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddb414-1de8-42b1-8ea0-07d7ed72e15e None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:21.415114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddb414-1de8-42b1-8ea0-07d7ed72e15e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:21.415821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddb414-1de8-42b1-8ea0-07d7ed72e15e None admin] RBAC: Adding query filter params (interface=public, service_id=87cae45409a547e3963cc71eefc09aa9, region_id=RegionOne) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:21.416127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddb414-1de8-42b1-8ea0-07d7ed72e15e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:21.417541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddb414-1de8-42b1-8ea0-07d7ed72e15e None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:21.423071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 504/996] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 31 19:09:21 2022] GET /identity/v3/endpoints?service_id=87cae45409a547e3963cc71eefc09aa9&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:21.428967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddb414-1de8-42b1-8ea0-07d7ed72e15e None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:21.493703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 493/997] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:21.560619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddb414-1de8-42b1-8ea0-07d7ed72e15e None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:21.578294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:21.599673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de3842-e29e-4b9f-b074-3d9db74eee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:21.600472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3842-e29e-4b9f-b074-3d9db74eee27 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:21.600886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3842-e29e-4b9f-b074-3d9db74eee27 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:21.601342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3842-e29e-4b9f-b074-3d9db74eee27 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:21.602152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de3842-e29e-4b9f-b074-3d9db74eee27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:21.603772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de3842-e29e-4b9f-b074-3d9db74eee27 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:21.617754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 505/998] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 31 19:09:21 2022] GET /identity/v3/services => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:09:21.769161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe74a0-1715-491a-8d30-c4bad884d96f None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:21.847900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:21.897132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe74a0-1715-491a-8d30-c4bad884d96f None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:21.940916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1c0b3-2d95-446b-b9c4-56f54ab51228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:21.941576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1c0b3-2d95-446b-b9c4-56f54ab51228 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:21.941858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1c0b3-2d95-446b-b9c4-56f54ab51228 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:21.942135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1c0b3-2d95-446b-b9c4-56f54ab51228 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:21.942739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1c0b3-2d95-446b-b9c4-56f54ab51228 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:21.944167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1c0b3-2d95-446b-b9c4-56f54ab51228 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-86d1c0b3-2d95-446b-b9c4-56f54ab51228 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:21.954296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:21.955883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:21.958631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 494/999] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 31 19:09:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:21.962990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de3842-e29e-4b9f-b074-3d9db74eee27 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:22.078783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de3842-e29e-4b9f-b074-3d9db74eee27 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:22.117312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682fa47-6fe8-4f44-9573-86afbcc0f5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:22.117955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682fa47-6fe8-4f44-9573-86afbcc0f5fa None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:22.118242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682fa47-6fe8-4f44-9573-86afbcc0f5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:22.118517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682fa47-6fe8-4f44-9573-86afbcc0f5fa None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:22.119156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682fa47-6fe8-4f44-9573-86afbcc0f5fa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:22.119460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682fa47-6fe8-4f44-9573-86afbcc0f5fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:22.120828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682fa47-6fe8-4f44-9573-86afbcc0f5fa None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:22.130780 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 506/1000] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 31 19:09:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:22.132516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1c0b3-2d95-446b-b9c4-56f54ab51228 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:22.243688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1c0b3-2d95-446b-b9c4-56f54ab51228 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:22.269539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:22.282733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061bf53-6119-4ff0-b2ee-a0dadcf43e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:22.284636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061bf53-6119-4ff0-b2ee-a0dadcf43e5f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:22.284636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061bf53-6119-4ff0-b2ee-a0dadcf43e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:22.284636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061bf53-6119-4ff0-b2ee-a0dadcf43e5f None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:22.284636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061bf53-6119-4ff0-b2ee-a0dadcf43e5f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:22.285049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061bf53-6119-4ff0-b2ee-a0dadcf43e5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:22.286432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061bf53-6119-4ff0-b2ee-a0dadcf43e5f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:22.296856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 495/1001] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 31 19:09:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:22.298603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682fa47-6fe8-4f44-9573-86afbcc0f5fa None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:22.348132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:22.403423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682fa47-6fe8-4f44-9573-86afbcc0f5fa None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:22.437450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc040329-1761-46ca-be72-51b543d8a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:22.438099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc040329-1761-46ca-be72-51b543d8a64c None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:22.438410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc040329-1761-46ca-be72-51b543d8a64c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:22.438650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc040329-1761-46ca-be72-51b543d8a64c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:22.439335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc040329-1761-46ca-be72-51b543d8a64c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:22.441287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc040329-1761-46ca-be72-51b543d8a64c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:22.560332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 507/1002] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:09:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:22.770376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735b0f-5c53-4032-9d6a-50c9c8982210 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:22.770641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735b0f-5c53-4032-9d6a-50c9c8982210 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:22.771126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735b0f-5c53-4032-9d6a-50c9c8982210 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:22.772443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 496/1003] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:22.777742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaabd0f-cd35-4f0a-82ba-c058af218e72 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:22.778130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaabd0f-cd35-4f0a-82ba-c058af218e72 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:22.778278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaabd0f-cd35-4f0a-82ba-c058af218e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:22.796653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-5eaabd0f-cd35-4f0a-82ba-c058af218e72 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:22.797867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-5eaabd0f-cd35-4f0a-82ba-c058af218e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:22.882364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 508/1004] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:23.148088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57735b0f-5c53-4032-9d6a-50c9c8982210 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:23.257713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57735b0f-5c53-4032-9d6a-50c9c8982210 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:23.292113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3137d-5c1a-4c42-bb18-848cab28c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:23.292733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3137d-5c1a-4c42-bb18-848cab28c7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:23.293010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3137d-5c1a-4c42-bb18-848cab28c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:23.293279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3137d-5c1a-4c42-bb18-848cab28c7d1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:23.293875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3137d-5c1a-4c42-bb18-848cab28c7d1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:23.295222 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3137d-5c1a-4c42-bb18-848cab28c7d1 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b9b3137d-5c1a-4c42-bb18-848cab28c7d1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:23.304380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:23.305328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:23.306192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:23.309746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 497/1005] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 31 19:09:23 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:23.311674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaabd0f-cd35-4f0a-82ba-c058af218e72 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:23.344445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:23.419279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaabd0f-cd35-4f0a-82ba-c058af218e72 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:23.455771 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c8780-0b31-4eb0-8365-1f7994db7dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:23.456384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c8780-0b31-4eb0-8365-1f7994db7dab None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:23.456662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c8780-0b31-4eb0-8365-1f7994db7dab None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:23.456936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c8780-0b31-4eb0-8365-1f7994db7dab None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:23.457568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c8780-0b31-4eb0-8365-1f7994db7dab None admin] RBAC: Adding query filter params (name=image) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:23.458029 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c8780-0b31-4eb0-8365-1f7994db7dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:23.459390 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c8780-0b31-4eb0-8365-1f7994db7dab None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:23.464394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 509/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:23.470049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3137d-5c1a-4c42-bb18-848cab28c7d1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:23.531620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:23.594207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3137d-5c1a-4c42-bb18-848cab28c7d1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:23.598252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c04ee-e831-467c-bf25-50951bdc68fa None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:23.598543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c04ee-e831-467c-bf25-50951bdc68fa None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:23.598822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c04ee-e831-467c-bf25-50951bdc68fa None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:23.600319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 510/1007] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:23.605356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18782c6-689e-4d85-a399-ceb55afd6b8b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:23.605653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18782c6-689e-4d85-a399-ceb55afd6b8b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:23.605964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18782c6-689e-4d85-a399-ceb55afd6b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:23.628834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a18782c6-689e-4d85-a399-ceb55afd6b8b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:23.630084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a18782c6-689e-4d85-a399-ceb55afd6b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:23.644800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fd3d1-c58a-455b-bb6b-ad9f1777e886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:23.645419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fd3d1-c58a-455b-bb6b-ad9f1777e886 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:23.645723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fd3d1-c58a-455b-bb6b-ad9f1777e886 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:23.646263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fd3d1-c58a-455b-bb6b-ad9f1777e886 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:23.646937 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fd3d1-c58a-455b-bb6b-ad9f1777e886 None admin] RBAC: Adding query filter params (type=image) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:23.647242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fd3d1-c58a-455b-bb6b-ad9f1777e886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:23.648611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fd3d1-c58a-455b-bb6b-ad9f1777e886 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:23.653342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 498/1008] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:23.708860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 511/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:23.975776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fd3d1-c58a-455b-bb6b-ad9f1777e886 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:24.086288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fd3d1-c58a-455b-bb6b-ad9f1777e886 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:24.102216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:24.122319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd52dbb-6c10-45ff-a64d-e62312e2fc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:24.123182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd52dbb-6c10-45ff-a64d-e62312e2fc9c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:24.123462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd52dbb-6c10-45ff-a64d-e62312e2fc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:24.123734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd52dbb-6c10-45ff-a64d-e62312e2fc9c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:24.124317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd52dbb-6c10-45ff-a64d-e62312e2fc9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:24.125697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd52dbb-6c10-45ff-a64d-e62312e2fc9c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-4cd52dbb-6c10-45ff-a64d-e62312e2fc9c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:24.135038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:24.136126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:09:24.136970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:24.141239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 499/1010] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:24.142102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18782c6-689e-4d85-a399-ceb55afd6b8b None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:24.170502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:24.250969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18782c6-689e-4d85-a399-ceb55afd6b8b None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:24.295431 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e5965-7c5c-4691-a783-3fc0165eb3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:24.296043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e5965-7c5c-4691-a783-3fc0165eb3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:24.296325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e5965-7c5c-4691-a783-3fc0165eb3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:24.296602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e5965-7c5c-4691-a783-3fc0165eb3f4 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:24.297275 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e5965-7c5c-4691-a783-3fc0165eb3f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:24.297577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e5965-7c5c-4691-a783-3fc0165eb3f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:24.298976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e5965-7c5c-4691-a783-3fc0165eb3f4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:24.308711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 512/1011] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:09:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:24.310328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd52dbb-6c10-45ff-a64d-e62312e2fc9c None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:24.422613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd52dbb-6c10-45ff-a64d-e62312e2fc9c None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:24.457539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9854c67-246b-4a7c-ab00-e921a6109e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:24.458183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854c67-246b-4a7c-ab00-e921a6109e58 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:24.458465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854c67-246b-4a7c-ab00-e921a6109e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:24.458739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854c67-246b-4a7c-ab00-e921a6109e58 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:24.459375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9854c67-246b-4a7c-ab00-e921a6109e58 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:24.459677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9854c67-246b-4a7c-ab00-e921a6109e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:24.461042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9854c67-246b-4a7c-ab00-e921a6109e58 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:24.470595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 500/1012] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 31 19:09:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:24.472085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e5965-7c5c-4691-a783-3fc0165eb3f4 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:24.555478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c408d5-ed2f-4e72-a961-0f56baaed72e None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:24.555782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c408d5-ed2f-4e72-a961-0f56baaed72e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:24.555970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c408d5-ed2f-4e72-a961-0f56baaed72e None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:24.557473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 501/1013] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:24.562229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722a7c0-6730-4aaa-81e6-5ae7e2f58185 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:24.562512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722a7c0-6730-4aaa-81e6-5ae7e2f58185 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:24.562787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722a7c0-6730-4aaa-81e6-5ae7e2f58185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:24.568945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:24.582835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e5965-7c5c-4691-a783-3fc0165eb3f4 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:24.583145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-0722a7c0-6730-4aaa-81e6-5ae7e2f58185 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:24.584298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0722a7c0-6730-4aaa-81e6-5ae7e2f58185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:24.620593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe2e67-f6ba-4508-a796-5345266b8d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:24.621246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe2e67-f6ba-4508-a796-5345266b8d8b None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:24.621525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe2e67-f6ba-4508-a796-5345266b8d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:24.621873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe2e67-f6ba-4508-a796-5345266b8d8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:24.621978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:24.622655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe2e67-f6ba-4508-a796-5345266b8d8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:24.624073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe2e67-f6ba-4508-a796-5345266b8d8b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:24.657567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 502/1014] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:24.717520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 513/1015] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:09:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:24.933175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722a7c0-6730-4aaa-81e6-5ae7e2f58185 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:25.045005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722a7c0-6730-4aaa-81e6-5ae7e2f58185 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:25.111224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ff18e-5231-48e0-bc32-675974aaa190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:25.112237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff18e-5231-48e0-bc32-675974aaa190 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:25.112496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff18e-5231-48e0-bc32-675974aaa190 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:25.112769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff18e-5231-48e0-bc32-675974aaa190 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:25.113915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ff18e-5231-48e0-bc32-675974aaa190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:25.115395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ff18e-5231-48e0-bc32-675974aaa190 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:25.117319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 503/1016] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:25.124063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe2e67-f6ba-4508-a796-5345266b8d8b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:25.236676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe2e67-f6ba-4508-a796-5345266b8d8b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:25.278143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d00282-f634-4e7b-8a03-2273194855e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:25.278774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d00282-f634-4e7b-8a03-2273194855e8 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:25.279123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d00282-f634-4e7b-8a03-2273194855e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:25.279380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d00282-f634-4e7b-8a03-2273194855e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:25.280060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d00282-f634-4e7b-8a03-2273194855e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:25.281550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d00282-f634-4e7b-8a03-2273194855e8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:25.301365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:25.376156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 514/1017] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:09:25 2022] POST /identity/v3/projects => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:25.593793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2ac0b-bc0b-4638-91b6-ee79edf09a79 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:25.594446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2ac0b-bc0b-4638-91b6-ee79edf09a79 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:25.594446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2ac0b-bc0b-4638-91b6-ee79edf09a79 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:25.595853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 504/1018] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:25.601803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aeba41-b55a-487a-8fca-0c9b5b41ba90 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:25.602298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aeba41-b55a-487a-8fca-0c9b5b41ba90 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:25.602390 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aeba41-b55a-487a-8fca-0c9b5b41ba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:25.621010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b1aeba41-b55a-487a-8fca-0c9b5b41ba90 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:25.622259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b1aeba41-b55a-487a-8fca-0c9b5b41ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:25.699896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 515/1019] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:25 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:25.969710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2ac0b-bc0b-4638-91b6-ee79edf09a79 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:26.017538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:26.102449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2ac0b-bc0b-4638-91b6-ee79edf09a79 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:26.144738 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88528781-fdb9-4ad9-9f4d-8c01ae58c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:26.145359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88528781-fdb9-4ad9-9f4d-8c01ae58c93b None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:26.145642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88528781-fdb9-4ad9-9f4d-8c01ae58c93b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:26.145947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88528781-fdb9-4ad9-9f4d-8c01ae58c93b None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:26.146630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88528781-fdb9-4ad9-9f4d-8c01ae58c93b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:26.148028 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88528781-fdb9-4ad9-9f4d-8c01ae58c93b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:26.249805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 505/1020] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:09:25 2022] POST /identity/v3/services => generated 242 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:26.784633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b5807-2ee5-4f01-a7a0-ac9f1e0aba68 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:26.785222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b5807-2ee5-4f01-a7a0-ac9f1e0aba68 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:26.785222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b5807-2ee5-4f01-a7a0-ac9f1e0aba68 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:26.786761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 516/1021] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:26.791953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8e0af-8198-424b-88cf-34851445b78f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:26.792461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8e0af-8198-424b-88cf-34851445b78f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:26.792542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8e0af-8198-424b-88cf-34851445b78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:26.816858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-f3e8e0af-8198-424b-88cf-34851445b78f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:26.816858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f3e8e0af-8198-424b-88cf-34851445b78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:26.900112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 506/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:27.171907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b5807-2ee5-4f01-a7a0-ac9f1e0aba68 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:27.326345 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b5807-2ee5-4f01-a7a0-ac9f1e0aba68 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:27.373729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:27.388081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9873a-da66-4fb7-9488-6cbc1912821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:27.391322 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9873a-da66-4fb7-9488-6cbc1912821c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.391432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73076b-69aa-4118-97a4-4bbc348203f6 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.391515 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9873a-da66-4fb7-9488-6cbc1912821c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.391586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73076b-69aa-4118-97a4-4bbc348203f6 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.391586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73076b-69aa-4118-97a4-4bbc348203f6 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.391724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9873a-da66-4fb7-9488-6cbc1912821c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.391802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 507/1023] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:27.397607 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d696d-be6d-4525-a517-293841122c09 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.397996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d696d-be6d-4525-a517-293841122c09 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.398276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d696d-be6d-4525-a517-293841122c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.409392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9873a-da66-4fb7-9488-6cbc1912821c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:27.418809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-487d696d-be6d-4525-a517-293841122c09 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:27.420011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-487d696d-be6d-4525-a517-293841122c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-21f9873a-da66-4fb7-9488-6cbc1912821c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:27.420149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:27.421148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:27.422071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:27.422733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 517/1024] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 31 19:09:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:27.428867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9873a-da66-4fb7-9488-6cbc1912821c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:27.447396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:27.509883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 508/1025] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:27.564164 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9873a-da66-4fb7-9488-6cbc1912821c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:27.602703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc168da3-13f3-47e8-9e19-2b0b939d6091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:27.603328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc168da3-13f3-47e8-9e19-2b0b939d6091 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.603608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc168da3-13f3-47e8-9e19-2b0b939d6091 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.603880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc168da3-13f3-47e8-9e19-2b0b939d6091 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.604955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc168da3-13f3-47e8-9e19-2b0b939d6091 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:27.605232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc168da3-13f3-47e8-9e19-2b0b939d6091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:27.606641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc168da3-13f3-47e8-9e19-2b0b939d6091 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:27.620312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 518/1026] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 31 19:09:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:27.621574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d696d-be6d-4525-a517-293841122c09 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:27.729251 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d696d-be6d-4525-a517-293841122c09 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:27.763832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0a596-8a77-4a16-8732-76711f6c329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:27.764462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0a596-8a77-4a16-8732-76711f6c329e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.764739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0a596-8a77-4a16-8732-76711f6c329e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.765013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0a596-8a77-4a16-8732-76711f6c329e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.775732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0a596-8a77-4a16-8732-76711f6c329e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:27.777181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0a596-8a77-4a16-8732-76711f6c329e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:27.779890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc168da3-13f3-47e8-9e19-2b0b939d6091 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-36d0a596-8a77-4a16-8732-76711f6c329e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:27.793188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:27.794783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:27.795873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:27.795873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:27.795873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:27.795873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 509/1027] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:27.800614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0a596-8a77-4a16-8732-76711f6c329e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:27.804443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:27.850350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:27.903403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc168da3-13f3-47e8-9e19-2b0b939d6091 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:27.919541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0a596-8a77-4a16-8732-76711f6c329e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:27.938424 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312472e2-38f3-4853-897b-d95b9e03b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:27.939095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312472e2-38f3-4853-897b-d95b9e03b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.939379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312472e2-38f3-4853-897b-d95b9e03b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.939712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312472e2-38f3-4853-897b-d95b9e03b8d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.941331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312472e2-38f3-4853-897b-d95b9e03b8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:27.942799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312472e2-38f3-4853-897b-d95b9e03b8d3 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:27.944544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 519/1028] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:27.950300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312472e2-38f3-4853-897b-d95b9e03b8d3 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:27.955165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef15b6-12ec-4d8d-abb8-4a4ce8006d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:27.955802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef15b6-12ec-4d8d-abb8-4a4ce8006d52 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:27.956084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef15b6-12ec-4d8d-abb8-4a4ce8006d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:27.956358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef15b6-12ec-4d8d-abb8-4a4ce8006d52 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:27.957013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef15b6-12ec-4d8d-abb8-4a4ce8006d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:27.957319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef15b6-12ec-4d8d-abb8-4a4ce8006d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:27.958726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef15b6-12ec-4d8d-abb8-4a4ce8006d52 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:27.975310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 510/1029] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:27.976480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef15b6-12ec-4d8d-abb8-4a4ce8006d52 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:28.047856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:28.064364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312472e2-38f3-4853-897b-d95b9e03b8d3 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.081903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:28.089072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef15b6-12ec-4d8d-abb8-4a4ce8006d52 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.100547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb32105-99ef-4217-9f3b-f6e9382a610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.106211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb32105-99ef-4217-9f3b-f6e9382a610d None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.106211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb32105-99ef-4217-9f3b-f6e9382a610d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.106211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb32105-99ef-4217-9f3b-f6e9382a610d None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.106211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb32105-99ef-4217-9f3b-f6e9382a610d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:28.106211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb32105-99ef-4217-9f3b-f6e9382a610d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:28.125149 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e079a95-5508-4e15-9f44-39d153788864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.125998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e079a95-5508-4e15-9f44-39d153788864 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.126365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e079a95-5508-4e15-9f44-39d153788864 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.126673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e079a95-5508-4e15-9f44-39d153788864 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.134975 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e079a95-5508-4e15-9f44-39d153788864 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:28.136425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e079a95-5508-4e15-9f44-39d153788864 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-2e079a95-5508-4e15-9f44-39d153788864 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:28.149428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:28.150575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:28.151747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 511/1030] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 31 19:09:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:28.156375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e079a95-5508-4e15-9f44-39d153788864 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:28.217717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 520/1031] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:09:27 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:28.279892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e079a95-5508-4e15-9f44-39d153788864 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.290880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49217bd5-dca0-42a5-88c8-05f59672dd22 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.291293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49217bd5-dca0-42a5-88c8-05f59672dd22 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.291582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49217bd5-dca0-42a5-88c8-05f59672dd22 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.293365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 521/1032] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:28.300083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3307-a22f-40af-83ea-8e91b955ed44 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.300263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3307-a22f-40af-83ea-8e91b955ed44 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.300425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3307-a22f-40af-83ea-8e91b955ed44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.326089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a70e3307-a22f-40af-83ea-8e91b955ed44 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:28.326332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:28.327336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a70e3307-a22f-40af-83ea-8e91b955ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:28.339692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf76075-bfe8-4297-8fdc-90f74c512fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.340315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf76075-bfe8-4297-8fdc-90f74c512fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.340597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf76075-bfe8-4297-8fdc-90f74c512fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.345179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf76075-bfe8-4297-8fdc-90f74c512fe5 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.345179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf76075-bfe8-4297-8fdc-90f74c512fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:28.345179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf76075-bfe8-4297-8fdc-90f74c512fe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:28.345179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf76075-bfe8-4297-8fdc-90f74c512fe5 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:28.364411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 512/1033] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 31 19:09:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:28.370081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf76075-bfe8-4297-8fdc-90f74c512fe5 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:28.411786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 522/1034] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:28.480429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf76075-bfe8-4297-8fdc-90f74c512fe5 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.514888 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076b7c4-d55e-46e5-9255-16b6f64acbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.515650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076b7c4-d55e-46e5-9255-16b6f64acbdb None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.515776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076b7c4-d55e-46e5-9255-16b6f64acbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.516034 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076b7c4-d55e-46e5-9255-16b6f64acbdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.568653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:28.588567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076b7c4-d55e-46e5-9255-16b6f64acbdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:28.590039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076b7c4-d55e-46e5-9255-16b6f64acbdb None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:28.676647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3307-a22f-40af-83ea-8e91b955ed44 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:28.691995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 513/1035] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:28 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:09:28.698054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076b7c4-d55e-46e5-9255-16b6f64acbdb None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:28.787601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:28.790628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3307-a22f-40af-83ea-8e91b955ed44 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.792271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:28.808008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076b7c4-d55e-46e5-9255-16b6f64acbdb None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.833394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088212c-6b9b-47e7-a39c-a7af2446f006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.834082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088212c-6b9b-47e7-a39c-a7af2446f006 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.834360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088212c-6b9b-47e7-a39c-a7af2446f006 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.834631 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088212c-6b9b-47e7-a39c-a7af2446f006 None admin] PATH_INFO: `/v3/services/image` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.835286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088212c-6b9b-47e7-a39c-a7af2446f006 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:28.836574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088212c-6b9b-47e7-a39c-a7af2446f006 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-8088212c-6b9b-47e7-a39c-a7af2446f006 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:28.845201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:28.848180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:28.849172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 523/1036] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 31 19:09:28 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:28.852912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7e34-6422-47e0-81d6-8d888818558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.853273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088212c-6b9b-47e7-a39c-a7af2446f006 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:28.853752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7e34-6422-47e0-81d6-8d888818558b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.853957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7e34-6422-47e0-81d6-8d888818558b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.854237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7e34-6422-47e0-81d6-8d888818558b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.865474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb7e34-6422-47e0-81d6-8d888818558b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:28.866966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb7e34-6422-47e0-81d6-8d888818558b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-bcbb7e34-6422-47e0-81d6-8d888818558b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:28.882915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:28.884094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:28.885180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:28.885180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:28.885180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:28.886695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 514/1037] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:28.892226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7e34-6422-47e0-81d6-8d888818558b None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:28.964903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088212c-6b9b-47e7-a39c-a7af2446f006 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.994954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7e34-6422-47e0-81d6-8d888818558b None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:28.997981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5a958-4087-4bc8-8138-f80f5fc3abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:28.998603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5a958-4087-4bc8-8138-f80f5fc3abbb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:28.998889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5a958-4087-4bc8-8138-f80f5fc3abbb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:28.999163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5a958-4087-4bc8-8138-f80f5fc3abbb None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:28.999798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5a958-4087-4bc8-8138-f80f5fc3abbb None admin] RBAC: Adding query filter params (name=image) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:29.000103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5a958-4087-4bc8-8138-f80f5fc3abbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:29.001468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5a958-4087-4bc8-8138-f80f5fc3abbb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:29.007388 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 524/1038] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:29.013065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5a958-4087-4bc8-8138-f80f5fc3abbb None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:29.036380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1bd55-1af8-4b19-8279-33c70866e322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:29.037503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1bd55-1af8-4b19-8279-33c70866e322 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:29.037809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1bd55-1af8-4b19-8279-33c70866e322 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:29.038236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1bd55-1af8-4b19-8279-33c70866e322 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:29.038882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1bd55-1af8-4b19-8279-33c70866e322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:29.039186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1bd55-1af8-4b19-8279-33c70866e322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:29.040573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1bd55-1af8-4b19-8279-33c70866e322 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:29.042066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:29.047396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:29.053712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 515/1039] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:29.058963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1bd55-1af8-4b19-8279-33c70866e322 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:29.125913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5a958-4087-4bc8-8138-f80f5fc3abbb None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:29.161217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1bd55-1af8-4b19-8279-33c70866e322 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:29.163450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3637fb3-67d3-46fb-9f7b-bc667d19de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:29.164323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3637fb3-67d3-46fb-9f7b-bc667d19de28 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:29.164752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3637fb3-67d3-46fb-9f7b-bc667d19de28 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:29.165193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3637fb3-67d3-46fb-9f7b-bc667d19de28 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:29.165995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3637fb3-67d3-46fb-9f7b-bc667d19de28 None admin] RBAC: Adding query filter params (type=image) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:29.166441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3637fb3-67d3-46fb-9f7b-bc667d19de28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:29.167934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3637fb3-67d3-46fb-9f7b-bc667d19de28 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:29.173147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 525/1040] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:29.179164 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3637fb3-67d3-46fb-9f7b-bc667d19de28 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:29.204959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661eff-3bff-4684-8a3c-8f2febafa01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:29.205811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661eff-3bff-4684-8a3c-8f2febafa01c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:29.206092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661eff-3bff-4684-8a3c-8f2febafa01c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:29.206855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661eff-3bff-4684-8a3c-8f2febafa01c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:29.213846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb661eff-3bff-4684-8a3c-8f2febafa01c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:29.215275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb661eff-3bff-4684-8a3c-8f2febafa01c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-bb661eff-3bff-4684-8a3c-8f2febafa01c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:29.226676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:29.227781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:29.233614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:29.233614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:29.233614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:29.233614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:29.233614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:29.233614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:29.233614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:29.233614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:29.233614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 516/1041] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:29.233614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661eff-3bff-4684-8a3c-8f2febafa01c None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:29.289659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:29.294987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:29.297207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3637fb3-67d3-46fb-9f7b-bc667d19de28 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:29.333996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47441494-d95e-48c3-902d-b12166ed46a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:29.335466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47441494-d95e-48c3-902d-b12166ed46a1 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:29.335750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47441494-d95e-48c3-902d-b12166ed46a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:29.336129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47441494-d95e-48c3-902d-b12166ed46a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:29.336760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47441494-d95e-48c3-902d-b12166ed46a1 None admin] RBAC: Adding query filter params (interface=public, service_id=f8ee070a9b374e3b9e6ac02d60c91f2b, region_id=RegionOne) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:29.337063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47441494-d95e-48c3-902d-b12166ed46a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:29.338468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47441494-d95e-48c3-902d-b12166ed46a1 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:29.340687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661eff-3bff-4684-8a3c-8f2febafa01c None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:29.348815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 526/1042] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 31 19:09:29 2022] GET /identity/v3/endpoints?service_id=f8ee070a9b374e3b9e6ac02d60c91f2b&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:29.350118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47441494-d95e-48c3-902d-b12166ed46a1 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:29.403246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab19c7-5420-4c8c-8e43-1a6674868c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:29.404217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab19c7-5420-4c8c-8e43-1a6674868c14 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:29.404732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab19c7-5420-4c8c-8e43-1a6674868c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:29.405275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab19c7-5420-4c8c-8e43-1a6674868c14 None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:29.406787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab19c7-5420-4c8c-8e43-1a6674868c14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:29.407331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab19c7-5420-4c8c-8e43-1a6674868c14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:29.410402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab19c7-5420-4c8c-8e43-1a6674868c14 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:29.429832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 517/1043] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:29.435489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab19c7-5420-4c8c-8e43-1a6674868c14 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:29.464308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47441494-d95e-48c3-902d-b12166ed46a1 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:29.506584 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f56afa-6b35-47aa-978f-70fc9a36ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:29.507676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f56afa-6b35-47aa-978f-70fc9a36ae95 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:29.508635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f56afa-6b35-47aa-978f-70fc9a36ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:29.509120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f56afa-6b35-47aa-978f-70fc9a36ae95 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:29.510199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f56afa-6b35-47aa-978f-70fc9a36ae95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:29.512797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f56afa-6b35-47aa-978f-70fc9a36ae95 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:29.521352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 527/1044] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 31 19:09:29 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:09:29.551262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab19c7-5420-4c8c-8e43-1a6674868c14 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:29.568626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:29.591333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c430b-8131-4807-a8c5-8395ffec5396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:29.591955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c430b-8131-4807-a8c5-8395ffec5396 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:29.592235 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c430b-8131-4807-a8c5-8395ffec5396 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:29.592510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c430b-8131-4807-a8c5-8395ffec5396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:29.593429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c430b-8131-4807-a8c5-8395ffec5396 None admin] RBAC: Adding query filter params (role.id=0e6b112ed98e4963b1a301ab45684b48, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=799cbde43a3643a4beef892d23145112) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:29.593766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c430b-8131-4807-a8c5-8395ffec5396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:29.595246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c430b-8131-4807-a8c5-8395ffec5396 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:29.606093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 518/1045] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:29 2022] GET /identity/v3/role_assignments?user.id=799cbde43a3643a4beef892d23145112&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=0e6b112ed98e4963b1a301ab45684b48 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:30.218629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27fad0-7db2-4d61-bdf4-50d6013e79d4 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:30.219339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27fad0-7db2-4d61-bdf4-50d6013e79d4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:30.219339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27fad0-7db2-4d61-bdf4-50d6013e79d4 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:30.220624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 528/1046] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:30.226558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f5d49-4e8b-4c8b-941b-75256722ca63 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:30.226985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f5d49-4e8b-4c8b-941b-75256722ca63 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:30.227150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f5d49-4e8b-4c8b-941b-75256722ca63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:30.245216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-fe1f5d49-4e8b-4c8b-941b-75256722ca63 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:30.246429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fe1f5d49-4e8b-4c8b-941b-75256722ca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:30.317729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 519/1047] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:30.585797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27fad0-7db2-4d61-bdf4-50d6013e79d4 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:30.623709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:30.714040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27fad0-7db2-4d61-bdf4-50d6013e79d4 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:30.765904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd466-99c6-4d1d-9454-830115d2438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:30.766546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd466-99c6-4d1d-9454-830115d2438c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:30.766822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd466-99c6-4d1d-9454-830115d2438c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:30.767101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd466-99c6-4d1d-9454-830115d2438c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:30.778401 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd466-99c6-4d1d-9454-830115d2438c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-ea2fd466-99c6-4d1d-9454-830115d2438c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:30.783398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:30.784826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:30.785650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:30.789756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 529/1048] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:30.791528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f5d49-4e8b-4c8b-941b-75256722ca63 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:30.900637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f5d49-4e8b-4c8b-941b-75256722ca63 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:30.910598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:30.937366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2aac6-0a28-4c21-9ebe-7371b8b17774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:30.938328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2aac6-0a28-4c21-9ebe-7371b8b17774 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:30.938650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2aac6-0a28-4c21-9ebe-7371b8b17774 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:30.939064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2aac6-0a28-4c21-9ebe-7371b8b17774 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:30.940569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2aac6-0a28-4c21-9ebe-7371b8b17774 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:30.940890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2aac6-0a28-4c21-9ebe-7371b8b17774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:30.942296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2aac6-0a28-4c21-9ebe-7371b8b17774 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:30.955794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 520/1049] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:30.957193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd466-99c6-4d1d-9454-830115d2438c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.042979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:31.062352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd466-99c6-4d1d-9454-830115d2438c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:31.097284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159c5b3-283b-4415-b4b2-7265ef547294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:31.097951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159c5b3-283b-4415-b4b2-7265ef547294 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.098240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159c5b3-283b-4415-b4b2-7265ef547294 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.098520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159c5b3-283b-4415-b4b2-7265ef547294 None admin] PATH_INFO: `/v3/users/ddb8ca168f204406a4e01e2e0fc6e982` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.112888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159c5b3-283b-4415-b4b2-7265ef547294 None admin] RBAC: Authorizing `identity:get_user(user_id=ddb8ca168f204406a4e01e2e0fc6e982)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:31.114367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159c5b3-283b-4415-b4b2-7265ef547294 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:31.116244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 530/1050] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:30 2022] GET /identity/v3/users/ddb8ca168f204406a4e01e2e0fc6e982 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:31.121949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2aac6-0a28-4c21-9ebe-7371b8b17774 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.232189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2aac6-0a28-4c21-9ebe-7371b8b17774 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:31.268512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7a3a3-8918-443d-b467-04a8b2ac7863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:31.269131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7a3a3-8918-443d-b467-04a8b2ac7863 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.269406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7a3a3-8918-443d-b467-04a8b2ac7863 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.269696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7a3a3-8918-443d-b467-04a8b2ac7863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.316347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:31.348053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7a3a3-8918-443d-b467-04a8b2ac7863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:31.349786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7a3a3-8918-443d-b467-04a8b2ac7863 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:31.453628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 521/1051] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:09:31.454943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159c5b3-283b-4415-b4b2-7265ef547294 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.463088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e8fc-2eab-4a73-9dfd-cc233eebf8bb None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.463377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e8fc-2eab-4a73-9dfd-cc233eebf8bb None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.463659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e8fc-2eab-4a73-9dfd-cc233eebf8bb None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.465136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 522/1052] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:31.469876 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5864032-4be9-4c48-bdef-0c56e710453e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.470168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5864032-4be9-4c48-bdef-0c56e710453e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.470443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5864032-4be9-4c48-bdef-0c56e710453e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.490118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c5864032-4be9-4c48-bdef-0c56e710453e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:31.491238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c5864032-4be9-4c48-bdef-0c56e710453e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:31.556769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:31.561411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 523/1053] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:31.565134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159c5b3-283b-4415-b4b2-7265ef547294 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:31.567086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b45b-ea37-4e37-964f-c52725cea65c None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.567490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b45b-ea37-4e37-964f-c52725cea65c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.573356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b45b-ea37-4e37-964f-c52725cea65c None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.573356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 524/1054] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:31.575191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58a9fe-c698-490d-b671-6dad73a21a8a None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.575481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58a9fe-c698-490d-b671-6dad73a21a8a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.575763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58a9fe-c698-490d-b671-6dad73a21a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.602937 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5a58a9fe-c698-490d-b671-6dad73a21a8a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:31.604210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5a58a9fe-c698-490d-b671-6dad73a21a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:31.605233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179af45-7267-4f43-bc93-2c48e97c0a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:31.605893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179af45-7267-4f43-bc93-2c48e97c0a5e None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.606180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179af45-7267-4f43-bc93-2c48e97c0a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.606456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179af45-7267-4f43-bc93-2c48e97c0a5e None admin] PATH_INFO: `/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.607575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179af45-7267-4f43-bc93-2c48e97c0a5e None admin] RBAC: Authorizing `identity:get_project(project_id=b7a59a5ed18c42c8ad1aeaa997309510)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:31.608988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179af45-7267-4f43-bc93-2c48e97c0a5e None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:31.615610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 531/1055] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:31 2022] GET /identity/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:31.616572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179af45-7267-4f43-bc93-2c48e97c0a5e None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.628789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:31.682447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 525/1056] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:31.731553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179af45-7267-4f43-bc93-2c48e97c0a5e None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:31.768590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276ce51-a1f0-4ef9-8468-813f5cd1bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:31.769085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276ce51-a1f0-4ef9-8468-813f5cd1bba2 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:31.769360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276ce51-a1f0-4ef9-8468-813f5cd1bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:31.769618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276ce51-a1f0-4ef9-8468-813f5cd1bba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:31.770378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276ce51-a1f0-4ef9-8468-813f5cd1bba2 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=b7a59a5ed18c42c8ad1aeaa997309510, user.id=ddb8ca168f204406a4e01e2e0fc6e982) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:31.770681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276ce51-a1f0-4ef9-8468-813f5cd1bba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:31.772387 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276ce51-a1f0-4ef9-8468-813f5cd1bba2 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:31.785710 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 532/1057] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:31 2022] GET /identity/v3/role_assignments?user.id=ddb8ca168f204406a4e01e2e0fc6e982&scope.project.id=b7a59a5ed18c42c8ad1aeaa997309510&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:31.831736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58a9fe-c698-490d-b671-6dad73a21a8a None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.959474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58a9fe-c698-490d-b671-6dad73a21a8a None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:31.961506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276ce51-a1f0-4ef9-8468-813f5cd1bba2 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:31.991966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:31.999715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fd141-baea-45da-8e4c-15e28ea91bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:32.004162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fd141-baea-45da-8e4c-15e28ea91bab None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.004162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fd141-baea-45da-8e4c-15e28ea91bab None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.004162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fd141-baea-45da-8e4c-15e28ea91bab None admin] PATH_INFO: `/v3/services/image` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:32.004162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fd141-baea-45da-8e4c-15e28ea91bab None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:32.004457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fd141-baea-45da-8e4c-15e28ea91bab None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-4a2fd141-baea-45da-8e4c-15e28ea91bab None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:32.015590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:32.016691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:32.019031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 526/1058] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 31 19:09:31 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:32.024859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fd141-baea-45da-8e4c-15e28ea91bab None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:32.037262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:32.068260 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276ce51-a1f0-4ef9-8468-813f5cd1bba2 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:32.108482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241813ff-f1df-4f60-bb54-1ff6c5a70afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:32.109197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241813ff-f1df-4f60-bb54-1ff6c5a70afd None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.109395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241813ff-f1df-4f60-bb54-1ff6c5a70afd None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.109656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241813ff-f1df-4f60-bb54-1ff6c5a70afd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:32.120069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241813ff-f1df-4f60-bb54-1ff6c5a70afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-241813ff-f1df-4f60-bb54-1ff6c5a70afd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:32.125365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:32.126377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:32.127759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 533/1059] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 31 19:09:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:32.132788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241813ff-f1df-4f60-bb54-1ff6c5a70afd None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:32.136150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fd141-baea-45da-8e4c-15e28ea91bab None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:32.171330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd40276-2aa9-40c4-a5ee-df82edb12e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:32.171944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd40276-2aa9-40c4-a5ee-df82edb12e96 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.172230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd40276-2aa9-40c4-a5ee-df82edb12e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.172509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd40276-2aa9-40c4-a5ee-df82edb12e96 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:32.173147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd40276-2aa9-40c4-a5ee-df82edb12e96 None admin] RBAC: Adding query filter params (name=image) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:32.173457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd40276-2aa9-40c4-a5ee-df82edb12e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:32.174899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd40276-2aa9-40c4-a5ee-df82edb12e96 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:32.182056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 527/1060] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:32.186169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd40276-2aa9-40c4-a5ee-df82edb12e96 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:32.242004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241813ff-f1df-4f60-bb54-1ff6c5a70afd None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:32.248177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:32.273422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:32.279429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9034a-a911-45f9-941a-a4ef9b47b6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:32.280050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9034a-a911-45f9-941a-a4ef9b47b6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.280340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9034a-a911-45f9-941a-a4ef9b47b6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.280622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9034a-a911-45f9-941a-a4ef9b47b6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:32.281309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9034a-a911-45f9-941a-a4ef9b47b6d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:32.281622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9034a-a911-45f9-941a-a4ef9b47b6d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:32.283017 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9034a-a911-45f9-941a-a4ef9b47b6d3 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:32.296343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 534/1061] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 31 19:09:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:32.296550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd40276-2aa9-40c4-a5ee-df82edb12e96 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:32.297403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9034a-a911-45f9-941a-a4ef9b47b6d3 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:32.328697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf1981-fc03-4943-89e5-6f6764509517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:32.329316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf1981-fc03-4943-89e5-6f6764509517 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.329598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf1981-fc03-4943-89e5-6f6764509517 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.329901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf1981-fc03-4943-89e5-6f6764509517 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:32.330580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf1981-fc03-4943-89e5-6f6764509517 None admin] RBAC: Adding query filter params (type=image) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:32.330886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf1981-fc03-4943-89e5-6f6764509517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:32.332247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf1981-fc03-4943-89e5-6f6764509517 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:32.337240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 528/1062] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:32.342827 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf1981-fc03-4943-89e5-6f6764509517 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:32.415231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9034a-a911-45f9-941a-a4ef9b47b6d3 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:32.458257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3a59-418c-4492-844e-1c36b3ccdb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:32.459350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3a59-418c-4492-844e-1c36b3ccdb9c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.459350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3a59-418c-4492-844e-1c36b3ccdb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.459506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3a59-418c-4492-844e-1c36b3ccdb9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:32.472265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf1981-fc03-4943-89e5-6f6764509517 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:32.472469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3a59-418c-4492-844e-1c36b3ccdb9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:32.474041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3a59-418c-4492-844e-1c36b3ccdb9c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-607b3a59-418c-4492-844e-1c36b3ccdb9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:32.492175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:32.493296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:32.494648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:32.494648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:32.494648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:32.494648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 535/1063] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:32.498652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:32.498957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3a59-418c-4492-844e-1c36b3ccdb9c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:32.515457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd251a59-7806-4141-bc94-579335270c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:32.515457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd251a59-7806-4141-bc94-579335270c57 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.515457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd251a59-7806-4141-bc94-579335270c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.515457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd251a59-7806-4141-bc94-579335270c57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:32.519983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd251a59-7806-4141-bc94-579335270c57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:32.519983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd251a59-7806-4141-bc94-579335270c57 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:32.546669 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:32.603251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3a59-418c-4492-844e-1c36b3ccdb9c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:32.633759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 529/1064] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:09:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:32.653309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53986f15-aef8-41c9-a5ec-abb652184090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:32.654045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53986f15-aef8-41c9-a5ec-abb652184090 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.654330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53986f15-aef8-41c9-a5ec-abb652184090 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.654629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53986f15-aef8-41c9-a5ec-abb652184090 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:32.655281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53986f15-aef8-41c9-a5ec-abb652184090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:32.655577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53986f15-aef8-41c9-a5ec-abb652184090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:32.656980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53986f15-aef8-41c9-a5ec-abb652184090 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:32.678851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 536/1065] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:32.680232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd251a59-7806-4141-bc94-579335270c57 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:32.831238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd251a59-7806-4141-bc94-579335270c57 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:32.892620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501aaa1-5435-422b-a1bc-524b3f4b712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:32.894074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501aaa1-5435-422b-a1bc-524b3f4b712b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.894813 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501aaa1-5435-422b-a1bc-524b3f4b712b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.895484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501aaa1-5435-422b-a1bc-524b3f4b712b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:32.910516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501aaa1-5435-422b-a1bc-524b3f4b712b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:32.913307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501aaa1-5435-422b-a1bc-524b3f4b712b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-e501aaa1-5435-422b-a1bc-524b3f4b712b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:32.934206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:32.935875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:32.938257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:32.938257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:32.938257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:32.938257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:32.938257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:32.938257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:32.938257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:32.938257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:32.938257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:09:32.938257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:32.941181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 530/1066] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 31 19:09:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:32.942712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53986f15-aef8-41c9-a5ec-abb652184090 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:33.090703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53986f15-aef8-41c9-a5ec-abb652184090 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:33.092589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:33.130599 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9510a9c-c39d-4696-8889-71be0127f632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:33.131223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9510a9c-c39d-4696-8889-71be0127f632 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.131502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9510a9c-c39d-4696-8889-71be0127f632 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.131772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9510a9c-c39d-4696-8889-71be0127f632 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.132513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9510a9c-c39d-4696-8889-71be0127f632 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:33.132816 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9510a9c-c39d-4696-8889-71be0127f632 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:33.134289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9510a9c-c39d-4696-8889-71be0127f632 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:33.154291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 537/1067] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 31 19:09:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:33.161610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501aaa1-5435-422b-a1bc-524b3f4b712b None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:33.203493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:33.270424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501aaa1-5435-422b-a1bc-524b3f4b712b None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:33.317555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a89142-a8f8-4586-83f0-0ac5c03a73d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:33.318073 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a89142-a8f8-4586-83f0-0ac5c03a73d7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.318351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a89142-a8f8-4586-83f0-0ac5c03a73d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.318618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a89142-a8f8-4586-83f0-0ac5c03a73d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.329926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a89142-a8f8-4586-83f0-0ac5c03a73d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:33.331911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a89142-a8f8-4586-83f0-0ac5c03a73d7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-d4a89142-a8f8-4586-83f0-0ac5c03a73d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:33.346879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:33.347926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:33.348809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:33.348809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:33.348809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:33.349992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 531/1068] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:33.353869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9510a9c-c39d-4696-8889-71be0127f632 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:33.456637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9510a9c-c39d-4696-8889-71be0127f632 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:33.490884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75fa50-f766-4c7b-8942-07aa72060170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:33.491673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75fa50-f766-4c7b-8942-07aa72060170 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.491841 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75fa50-f766-4c7b-8942-07aa72060170 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.492117 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75fa50-f766-4c7b-8942-07aa72060170 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.492755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75fa50-f766-4c7b-8942-07aa72060170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:33.493057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75fa50-f766-4c7b-8942-07aa72060170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:33.494425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75fa50-f766-4c7b-8942-07aa72060170 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:33.511176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 538/1069] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:33.512953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a89142-a8f8-4586-83f0-0ac5c03a73d7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:33.615119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:33.625003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a89142-a8f8-4586-83f0-0ac5c03a73d7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:33.661011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a1203-3276-452d-a8b1-6cd2df8cf24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:33.661634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a1203-3276-452d-a8b1-6cd2df8cf24e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.661943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a1203-3276-452d-a8b1-6cd2df8cf24e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.662212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a1203-3276-452d-a8b1-6cd2df8cf24e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.668916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a1203-3276-452d-a8b1-6cd2df8cf24e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:33.670366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a1203-3276-452d-a8b1-6cd2df8cf24e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b94a1203-3276-452d-a8b1-6cd2df8cf24e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:33.681785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:33.682725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:33.683589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:33.683589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:33.683589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:33.683589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:33.683589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:33.683589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:33.683589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:33.683589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:33.686044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 532/1070] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:33.688905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75fa50-f766-4c7b-8942-07aa72060170 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:33.714884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:33.724011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b2a6b-f688-46d3-9d5e-9ef5e99fe875 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.724289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b2a6b-f688-46d3-9d5e-9ef5e99fe875 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.724560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b2a6b-f688-46d3-9d5e-9ef5e99fe875 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.726079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 533/1071] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:33.730892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857506d6-4686-418e-8ef4-eaac286ed8ae None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.731176 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857506d6-4686-418e-8ef4-eaac286ed8ae None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.731452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857506d6-4686-418e-8ef4-eaac286ed8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.750910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-857506d6-4686-418e-8ef4-eaac286ed8ae None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:33.752628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-857506d6-4686-418e-8ef4-eaac286ed8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:33.797585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75fa50-f766-4c7b-8942-07aa72060170 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:33.833433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 534/1072] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:33.840963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f8be0-d8ec-40c9-b01a-a5254880fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:33.841578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f8be0-d8ec-40c9-b01a-a5254880fc66 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.841876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f8be0-d8ec-40c9-b01a-a5254880fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.842192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f8be0-d8ec-40c9-b01a-a5254880fc66 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.842837 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f8be0-d8ec-40c9-b01a-a5254880fc66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:33.843140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f8be0-d8ec-40c9-b01a-a5254880fc66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:33.844579 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f8be0-d8ec-40c9-b01a-a5254880fc66 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:33.857919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 539/1073] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:33.864387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857506d6-4686-418e-8ef4-eaac286ed8ae None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:33.949569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:33.968356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857506d6-4686-418e-8ef4-eaac286ed8ae None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.007581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8d1ef-2531-45e7-b9f0-d1420d4d400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.008245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8d1ef-2531-45e7-b9f0-d1420d4d400a None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.008525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8d1ef-2531-45e7-b9f0-d1420d4d400a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.008848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8d1ef-2531-45e7-b9f0-d1420d4d400a None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/799cbde43a3643a4beef892d23145112/roles/0e6b112ed98e4963b1a301ab45684b48` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.011064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8d1ef-2531-45e7-b9f0-d1420d4d400a None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=799cbde43a3643a4beef892d23145112, role_id=0e6b112ed98e4963b1a301ab45684b48)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:34.012529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8d1ef-2531-45e7-b9f0-d1420d4d400a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:34.072131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 535/1074] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:09:33 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/799cbde43a3643a4beef892d23145112/roles/0e6b112ed98e4963b1a301ab45684b48 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:09:34.123193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f8be0-d8ec-40c9-b01a-a5254880fc66 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.221508 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:34.250317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f8be0-d8ec-40c9-b01a-a5254880fc66 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.291014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67173a-3f9f-47b9-b48f-552afd291630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.291829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67173a-3f9f-47b9-b48f-552afd291630 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.292241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67173a-3f9f-47b9-b48f-552afd291630 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.292650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67173a-3f9f-47b9-b48f-552afd291630 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.305023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67173a-3f9f-47b9-b48f-552afd291630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-4f67173a-3f9f-47b9-b48f-552afd291630 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:34.310076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:34.311436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:34.313622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 540/1075] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:34.317706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8d1ef-2531-45e7-b9f0-d1420d4d400a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.433928 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8d1ef-2531-45e7-b9f0-d1420d4d400a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.468728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7781-1a78-47a3-933f-b25a4c96040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.469340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7781-1a78-47a3-933f-b25a4c96040a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.469613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7781-1a78-47a3-933f-b25a4c96040a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.469909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7781-1a78-47a3-933f-b25a4c96040a None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.470578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7781-1a78-47a3-933f-b25a4c96040a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:34.471411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7781-1a78-47a3-933f-b25a4c96040a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:34.472815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7781-1a78-47a3-933f-b25a4c96040a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:34.486158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 536/1076] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:34.488444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67173a-3f9f-47b9-b48f-552afd291630 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.599055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67173a-3f9f-47b9-b48f-552afd291630 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.611614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56934e-1c08-4106-b350-3c6e59100d5d None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.611874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56934e-1c08-4106-b350-3c6e59100d5d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.612165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56934e-1c08-4106-b350-3c6e59100d5d None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.613825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 537/1077] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:34.619417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f2c2a-7ce6-452e-9d07-52b8bbe15a76 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.619697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f2c2a-7ce6-452e-9d07-52b8bbe15a76 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.619966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f2c2a-7ce6-452e-9d07-52b8bbe15a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.626242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:34.638319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548239f4-225e-4e3d-816e-a71a1971328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.638960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548239f4-225e-4e3d-816e-a71a1971328f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.639095 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-375f2c2a-7ce6-452e-9d07-52b8bbe15a76 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:34.639284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548239f4-225e-4e3d-816e-a71a1971328f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.639517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548239f4-225e-4e3d-816e-a71a1971328f None admin] PATH_INFO: `/v3/users/ddb8ca168f204406a4e01e2e0fc6e982` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.640400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-375f2c2a-7ce6-452e-9d07-52b8bbe15a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:34.640682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548239f4-225e-4e3d-816e-a71a1971328f None admin] RBAC: Authorizing `identity:get_user(user_id=ddb8ca168f204406a4e01e2e0fc6e982)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:34.642163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548239f4-225e-4e3d-816e-a71a1971328f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:34.644585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 541/1078] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:34 2022] GET /identity/v3/users/ddb8ca168f204406a4e01e2e0fc6e982 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:34.650821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548239f4-225e-4e3d-816e-a71a1971328f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.663506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:34.719059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 538/1079] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:34.758715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548239f4-225e-4e3d-816e-a71a1971328f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.792015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba46cf3-7859-4044-abfd-ee475cc36d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.792637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46cf3-7859-4044-abfd-ee475cc36d56 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.792915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46cf3-7859-4044-abfd-ee475cc36d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.793183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46cf3-7859-4044-abfd-ee475cc36d56 None admin] PATH_INFO: `/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.794307 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba46cf3-7859-4044-abfd-ee475cc36d56 None admin] RBAC: Authorizing `identity:get_project(project_id=b7a59a5ed18c42c8ad1aeaa997309510)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:34.795713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba46cf3-7859-4044-abfd-ee475cc36d56 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:34.797483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 542/1080] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:34 2022] GET /identity/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:34.803364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f2c2a-7ce6-452e-9d07-52b8bbe15a76 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:34.907880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f2c2a-7ce6-452e-9d07-52b8bbe15a76 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:34.937278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:34.942464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb30135-698e-497b-936b-ded50044c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:34.943123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb30135-698e-497b-936b-ded50044c8f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:34.943398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb30135-698e-497b-936b-ded50044c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:34.943667 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb30135-698e-497b-936b-ded50044c8f8 None admin] PATH_INFO: `/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510/users/ddb8ca168f204406a4e01e2e0fc6e982/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:34.945571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb30135-698e-497b-936b-ded50044c8f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7a59a5ed18c42c8ad1aeaa997309510, user_id=ddb8ca168f204406a4e01e2e0fc6e982, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:34.947260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb30135-698e-497b-936b-ded50044c8f8 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:34.985356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba46cf3-7859-4044-abfd-ee475cc36d56 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:35.065370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 539/1081] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:09:34 2022] PUT /identity/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510/users/ddb8ca168f204406a4e01e2e0fc6e982/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:09:35.074125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:35.095274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba46cf3-7859-4044-abfd-ee475cc36d56 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:35.134662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef5cb-ce68-43d4-a116-03085a833a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:35.135293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef5cb-ce68-43d4-a116-03085a833a0c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:35.135644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef5cb-ce68-43d4-a116-03085a833a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:35.135927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef5cb-ce68-43d4-a116-03085a833a0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:35.216946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ef5cb-ce68-43d4-a116-03085a833a0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:35.218446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ef5cb-ce68-43d4-a116-03085a833a0c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:35.297919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:35.322039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 543/1082] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:09:35.327549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb30135-698e-497b-936b-ded50044c8f8 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:35.449506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb30135-698e-497b-936b-ded50044c8f8 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:35.491256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093d6a-28f5-472d-b8c7-68546d6748ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:35.491900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093d6a-28f5-472d-b8c7-68546d6748ad None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:35.492179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093d6a-28f5-472d-b8c7-68546d6748ad None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:35.492453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093d6a-28f5-472d-b8c7-68546d6748ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:35.504256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093d6a-28f5-472d-b8c7-68546d6748ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:35.505750 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093d6a-28f5-472d-b8c7-68546d6748ad None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-09093d6a-28f5-472d-b8c7-68546d6748ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:35.529279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:35.530342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:35.531250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:35.531250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:35.531250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:35.534041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 540/1083] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:35.537244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef5cb-ce68-43d4-a116-03085a833a0c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:35.651531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef5cb-ce68-43d4-a116-03085a833a0c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:35.691238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a797ee-1507-488d-bfa4-259cc7b61cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:35.691851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a797ee-1507-488d-bfa4-259cc7b61cbd None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:35.692133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a797ee-1507-488d-bfa4-259cc7b61cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:35.692395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a797ee-1507-488d-bfa4-259cc7b61cbd None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:35.693046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a797ee-1507-488d-bfa4-259cc7b61cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:35.693346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a797ee-1507-488d-bfa4-259cc7b61cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:35.694745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a797ee-1507-488d-bfa4-259cc7b61cbd None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:35.717713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 544/1084] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:36.036814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13243c-68e4-4b39-badd-560d72c87f16 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.037443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13243c-68e4-4b39-badd-560d72c87f16 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.037774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13243c-68e4-4b39-badd-560d72c87f16 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.039812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 541/1085] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:36.045593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a10568-194f-41da-a2aa-b9c85a940a32 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.045921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a10568-194f-41da-a2aa-b9c85a940a32 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.046305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a10568-194f-41da-a2aa-b9c85a940a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.065963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-37a10568-194f-41da-a2aa-b9c85a940a32 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:36.067179 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-37a10568-194f-41da-a2aa-b9c85a940a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:36.100458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:36.140897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 545/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:36.410717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13243c-68e4-4b39-badd-560d72c87f16 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:36.475819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:36.544990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13243c-68e4-4b39-badd-560d72c87f16 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:36.589528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8f2fc-4ddf-429f-a076-b95a51037ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:36.590422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8f2fc-4ddf-429f-a076-b95a51037ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.590897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8f2fc-4ddf-429f-a076-b95a51037ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.591366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8f2fc-4ddf-429f-a076-b95a51037ee1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.606620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8f2fc-4ddf-429f-a076-b95a51037ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-84d8f2fc-4ddf-429f-a076-b95a51037ee1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:36.616470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:36.617722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:36.622215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 542/1087] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 31 19:09:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:36.624508 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a10568-194f-41da-a2aa-b9c85a940a32 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:36.727120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a10568-194f-41da-a2aa-b9c85a940a32 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:36.762592 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233ff46-0ac8-4289-9252-67c9f233c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:36.763210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233ff46-0ac8-4289-9252-67c9f233c623 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.763495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233ff46-0ac8-4289-9252-67c9f233c623 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.763766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233ff46-0ac8-4289-9252-67c9f233c623 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.764467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233ff46-0ac8-4289-9252-67c9f233c623 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:36.764769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233ff46-0ac8-4289-9252-67c9f233c623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:36.766163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233ff46-0ac8-4289-9252-67c9f233c623 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:36.775335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 546/1088] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 31 19:09:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:36.781617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8f2fc-4ddf-429f-a076-b95a51037ee1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:36.888010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8f2fc-4ddf-429f-a076-b95a51037ee1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:36.890443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:36.921294 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832551a-8585-402d-866b-2b2b182b5f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:36.921957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832551a-8585-402d-866b-2b2b182b5f68 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.922236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832551a-8585-402d-866b-2b2b182b5f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.922509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832551a-8585-402d-866b-2b2b182b5f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.934027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832551a-8585-402d-866b-2b2b182b5f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:36.935477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832551a-8585-402d-866b-2b2b182b5f68 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-9832551a-8585-402d-866b-2b2b182b5f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:36.951356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:36.952400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:36.953290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:36.953290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:36.953290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:36.953945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 543/1089] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:36.958347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233ff46-0ac8-4289-9252-67c9f233c623 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:36.990756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:36.995618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb39b6-f64a-4ad4-82fb-96ccf6328845 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.995907 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb39b6-f64a-4ad4-82fb-96ccf6328845 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.996185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb39b6-f64a-4ad4-82fb-96ccf6328845 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.997525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 544/1090] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:09:37.003922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fac73b-7ed9-4feb-bd82-39eb86abd31b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.004214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fac73b-7ed9-4feb-bd82-39eb86abd31b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.004493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fac73b-7ed9-4feb-bd82-39eb86abd31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.030383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-b4fac73b-7ed9-4feb-bd82-39eb86abd31b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:37.031763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b4fac73b-7ed9-4feb-bd82-39eb86abd31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:37.063275 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233ff46-0ac8-4289-9252-67c9f233c623 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.097763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7554942-8f64-46bb-889d-11c671941f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.098367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7554942-8f64-46bb-889d-11c671941f5b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.098653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7554942-8f64-46bb-889d-11c671941f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.098933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7554942-8f64-46bb-889d-11c671941f5b None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.099579 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7554942-8f64-46bb-889d-11c671941f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:37.099880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7554942-8f64-46bb-889d-11c671941f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:37.101233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7554942-8f64-46bb-889d-11c671941f5b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:37.107842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 545/1091] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:37.114320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 547/1092] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:37.119945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fac73b-7ed9-4feb-bd82-39eb86abd31b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.210323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:37.225654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fac73b-7ed9-4feb-bd82-39eb86abd31b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.261025 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10885694-468b-4a45-8ece-834afa25eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.261580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885694-468b-4a45-8ece-834afa25eddb None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.261891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885694-468b-4a45-8ece-834afa25eddb None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.262172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885694-468b-4a45-8ece-834afa25eddb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.270176 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10885694-468b-4a45-8ece-834afa25eddb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:37.271615 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10885694-468b-4a45-8ece-834afa25eddb None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-10885694-468b-4a45-8ece-834afa25eddb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:09:37.284026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:37.285046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:37.286013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 546/1093] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:37.290983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7554942-8f64-46bb-889d-11c671941f5b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.377476 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10885694-468b-4a45-8ece-834afa25eddb None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.378330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:37.390353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7554942-8f64-46bb-889d-11c671941f5b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.425622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf0907-2778-4165-9ddf-989d1a034eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.426260 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0907-2778-4165-9ddf-989d1a034eee None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.426544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0907-2778-4165-9ddf-989d1a034eee None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.426820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0907-2778-4165-9ddf-989d1a034eee None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.427558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf0907-2778-4165-9ddf-989d1a034eee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:37.427861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf0907-2778-4165-9ddf-989d1a034eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:37.429286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf0907-2778-4165-9ddf-989d1a034eee None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:37.447518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 548/1094] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:37.453753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf0907-2778-4165-9ddf-989d1a034eee None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.483103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10885694-468b-4a45-8ece-834afa25eddb None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.517313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917f350-eb43-4319-8347-e533712ab80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.518344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f350-eb43-4319-8347-e533712ab80a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.518622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f350-eb43-4319-8347-e533712ab80a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.518893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f350-eb43-4319-8347-e533712ab80a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.529645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917f350-eb43-4319-8347-e533712ab80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-0917f350-eb43-4319-8347-e533712ab80a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:37.534518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:37.535457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:37.536283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 547/1095] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:37.542433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917f350-eb43-4319-8347-e533712ab80a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.554920 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:37.557525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf0907-2778-4165-9ddf-989d1a034eee None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.593918 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12148b-56a6-417e-97da-2f79e6c15048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.594582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12148b-56a6-417e-97da-2f79e6c15048 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.594872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12148b-56a6-417e-97da-2f79e6c15048 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.595161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12148b-56a6-417e-97da-2f79e6c15048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.610964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:37.651084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917f350-eb43-4319-8347-e533712ab80a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.667993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12148b-56a6-417e-97da-2f79e6c15048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:37.669515 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12148b-56a6-417e-97da-2f79e6c15048 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:37.688267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809d79-c81e-42a1-b1f8-15cffae952ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.688883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809d79-c81e-42a1-b1f8-15cffae952ab None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.689161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809d79-c81e-42a1-b1f8-15cffae952ab None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.690151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809d79-c81e-42a1-b1f8-15cffae952ab None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.691034 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809d79-c81e-42a1-b1f8-15cffae952ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:37.691158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809d79-c81e-42a1-b1f8-15cffae952ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:37.692495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809d79-c81e-42a1-b1f8-15cffae952ab None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:37.701455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 548/1096] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:37.708062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809d79-c81e-42a1-b1f8-15cffae952ab None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.774884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 549/1097] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:09:37.777063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:37.780567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12148b-56a6-417e-97da-2f79e6c15048 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.810919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809d79-c81e-42a1-b1f8-15cffae952ab None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.828220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:37.847929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e9f05-19b5-4067-bbc8-91e879fe2c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.848557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e9f05-19b5-4067-bbc8-91e879fe2c1e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.848838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e9f05-19b5-4067-bbc8-91e879fe2c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.849111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e9f05-19b5-4067-bbc8-91e879fe2c1e None admin] PATH_INFO: `/v3/users/ddb8ca168f204406a4e01e2e0fc6e982` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.850256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e9f05-19b5-4067-bbc8-91e879fe2c1e None admin] RBAC: Authorizing `identity:get_user(user_id=ddb8ca168f204406a4e01e2e0fc6e982)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:37.851847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e9f05-19b5-4067-bbc8-91e879fe2c1e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:37.853425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 549/1098] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/users/ddb8ca168f204406a4e01e2e0fc6e982 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:37.859466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e9f05-19b5-4067-bbc8-91e879fe2c1e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.881950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12148b-56a6-417e-97da-2f79e6c15048 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:37.915225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fe15d-4c48-4203-9668-bf85de68783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:37.916109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fe15d-4c48-4203-9668-bf85de68783d None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:37.916386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fe15d-4c48-4203-9668-bf85de68783d None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:37.916663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fe15d-4c48-4203-9668-bf85de68783d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:37.928304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fe15d-4c48-4203-9668-bf85de68783d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:37.929759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fe15d-4c48-4203-9668-bf85de68783d None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-277fe15d-4c48-4203-9668-bf85de68783d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:09:37.944100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:37.945146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:09:37.946345 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:09:37.946345 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:09:37.946345 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:37.946867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 550/1099] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:37.951257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fe15d-4c48-4203-9668-bf85de68783d None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:37.962507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e9f05-19b5-4067-bbc8-91e879fe2c1e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:38.002205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d0b04-189a-46d0-b1f7-2d29928a7407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:38.002846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d0b04-189a-46d0-b1f7-2d29928a7407 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:38.003124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d0b04-189a-46d0-b1f7-2d29928a7407 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:38.003397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d0b04-189a-46d0-b1f7-2d29928a7407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:38.010628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:38.046225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:38.051091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fe15d-4c48-4203-9668-bf85de68783d None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:38.078134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d0b04-189a-46d0-b1f7-2d29928a7407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:38.079578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d0b04-189a-46d0-b1f7-2d29928a7407 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:38.085429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395038f-3bc0-4900-a0a5-514a74840f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:38.086066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395038f-3bc0-4900-a0a5-514a74840f5f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:38.086350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395038f-3bc0-4900-a0a5-514a74840f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:38.086624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395038f-3bc0-4900-a0a5-514a74840f5f None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:38.087265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395038f-3bc0-4900-a0a5-514a74840f5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:38.087568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395038f-3bc0-4900-a0a5-514a74840f5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:38.088904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395038f-3bc0-4900-a0a5-514a74840f5f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:38.101103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 551/1100] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:38.106704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395038f-3bc0-4900-a0a5-514a74840f5f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:38.178473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 550/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:09:38.184293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d0b04-189a-46d0-b1f7-2d29928a7407 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:38.206135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395038f-3bc0-4900-a0a5-514a74840f5f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:38.220019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:38.239540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830849-20c7-43d8-a630-1160adf6c098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:38.240171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830849-20c7-43d8-a630-1160adf6c098 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:38.240453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830849-20c7-43d8-a630-1160adf6c098 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:38.240725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830849-20c7-43d8-a630-1160adf6c098 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:38.247417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11830849-20c7-43d8-a630-1160adf6c098 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:38.248843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11830849-20c7-43d8-a630-1160adf6c098 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-11830849-20c7-43d8-a630-1160adf6c098 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:09:38.261656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:38.262608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:38.263502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:09:38.263502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:09:38.263502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:09:38.263502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:09:38.263502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:09:38.263502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:09:38.263502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:09:38.263502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:09:38.263502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 552/1102] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:09:38.269284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830849-20c7-43d8-a630-1160adf6c098 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:38.285764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d0b04-189a-46d0-b1f7-2d29928a7407 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:38.288525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:38.323568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fb85e-8b4d-4846-8a61-5bc74c28df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:38.324119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fb85e-8b4d-4846-8a61-5bc74c28df9e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:38.324395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fb85e-8b4d-4846-8a61-5bc74c28df9e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:38.324678 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fb85e-8b4d-4846-8a61-5bc74c28df9e None admin] PATH_INFO: `/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:38.325839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fb85e-8b4d-4846-8a61-5bc74c28df9e None admin] RBAC: Authorizing `identity:get_project(project_id=b7a59a5ed18c42c8ad1aeaa997309510)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:38.327276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fb85e-8b4d-4846-8a61-5bc74c28df9e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:38.328944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 551/1103] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:38 2022] GET /identity/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:38.335052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fb85e-8b4d-4846-8a61-5bc74c28df9e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:38.373914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830849-20c7-43d8-a630-1160adf6c098 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:38.407723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8597196-88f2-49a2-9ede-c1ffe1070ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:38.408362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8597196-88f2-49a2-9ede-c1ffe1070ddb None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:38.408658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8597196-88f2-49a2-9ede-c1ffe1070ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:38.408913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8597196-88f2-49a2-9ede-c1ffe1070ddb None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:38.409607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8597196-88f2-49a2-9ede-c1ffe1070ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:38.409940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8597196-88f2-49a2-9ede-c1ffe1070ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:38.411359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8597196-88f2-49a2-9ede-c1ffe1070ddb None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:38.423611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 553/1104] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:38.431132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8597196-88f2-49a2-9ede-c1ffe1070ddb None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:38.440709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fb85e-8b4d-4846-8a61-5bc74c28df9e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:38.444122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:38.475900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930af24d-c07f-41c2-a6f7-d6f35f727747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:38.476507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af24d-c07f-41c2-a6f7-d6f35f727747 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:38.476789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af24d-c07f-41c2-a6f7-d6f35f727747 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:38.477066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af24d-c07f-41c2-a6f7-d6f35f727747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:38.477828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930af24d-c07f-41c2-a6f7-d6f35f727747 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=b7a59a5ed18c42c8ad1aeaa997309510, user.id=ddb8ca168f204406a4e01e2e0fc6e982) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:38.478139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930af24d-c07f-41c2-a6f7-d6f35f727747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:38.479571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930af24d-c07f-41c2-a6f7-d6f35f727747 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:38.485315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 552/1105] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:38 2022] GET /identity/v3/role_assignments?user.id=ddb8ca168f204406a4e01e2e0fc6e982&scope.project.id=b7a59a5ed18c42c8ad1aeaa997309510&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:38.514644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:38.538253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8597196-88f2-49a2-9ede-c1ffe1070ddb None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:38.577908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabbcff-3097-4cde-830b-e03b1d3fc7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:38.578305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabbcff-3097-4cde-830b-e03b1d3fc7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:38.578586 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabbcff-3097-4cde-830b-e03b1d3fc7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:38.578857 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabbcff-3097-4cde-830b-e03b1d3fc7f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:38.579602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabbcff-3097-4cde-830b-e03b1d3fc7f7 None admin] RBAC: Adding query filter params (role.id=0e6b112ed98e4963b1a301ab45684b48, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=799cbde43a3643a4beef892d23145112) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:38.579919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabbcff-3097-4cde-830b-e03b1d3fc7f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:38.581359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabbcff-3097-4cde-830b-e03b1d3fc7f7 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:38.588065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 554/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:38 2022] GET /identity/v3/role_assignments?user.id=799cbde43a3643a4beef892d23145112&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=0e6b112ed98e4963b1a301ab45684b48 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:40.439463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6ab1-4268-47b4-acbe-8ebbc7c79eb5 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:40.440021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6ab1-4268-47b4-acbe-8ebbc7c79eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:40.440021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6ab1-4268-47b4-acbe-8ebbc7c79eb5 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:40.441350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 553/1107] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:40.446721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdaaa9-a8fc-478f-bf08-cde9ca7b2a6c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:40.447144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdaaa9-a8fc-478f-bf08-cde9ca7b2a6c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:40.447262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdaaa9-a8fc-478f-bf08-cde9ca7b2a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:40.464821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3dfdaaa9-a8fc-478f-bf08-cde9ca7b2a6c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:40.466033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3dfdaaa9-a8fc-478f-bf08-cde9ca7b2a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:40.530446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 555/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:40.816184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea6ab1-4268-47b4-acbe-8ebbc7c79eb5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:40.915613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea6ab1-4268-47b4-acbe-8ebbc7c79eb5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:40.949820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287beec-a6d1-4fb7-a74e-ade44ad5fa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:40.950455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287beec-a6d1-4fb7-a74e-ade44ad5fa33 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:40.950735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287beec-a6d1-4fb7-a74e-ade44ad5fa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:40.951009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287beec-a6d1-4fb7-a74e-ade44ad5fa33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:40.952126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287beec-a6d1-4fb7-a74e-ade44ad5fa33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:40.953558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287beec-a6d1-4fb7-a74e-ade44ad5fa33 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:40.955768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 554/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:40.961770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdaaa9-a8fc-478f-bf08-cde9ca7b2a6c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:41.034632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:41.063744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdaaa9-a8fc-478f-bf08-cde9ca7b2a6c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:41.098536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b04655-fac6-4514-af75-5698094dde82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:41.099070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b04655-fac6-4514-af75-5698094dde82 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:41.099349 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b04655-fac6-4514-af75-5698094dde82 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:41.099630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b04655-fac6-4514-af75-5698094dde82 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:41.100292 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b04655-fac6-4514-af75-5698094dde82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:41.101820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b04655-fac6-4514-af75-5698094dde82 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:41.482037 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 556/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:09:40 2022] POST /identity/v3/users => generated 286 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:43.457545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35972f9b-e5b3-4f9a-8632-3b67d0493505 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:43.458141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35972f9b-e5b3-4f9a-8632-3b67d0493505 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:43.458252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35972f9b-e5b3-4f9a-8632-3b67d0493505 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:43.459606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 555/1111] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:43.465008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3ed46-836e-42c0-9840-802d63a78467 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:43.465488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3ed46-836e-42c0-9840-802d63a78467 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:43.465579 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3ed46-836e-42c0-9840-802d63a78467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:43.483693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-6bb3ed46-836e-42c0-9840-802d63a78467 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:43.484894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6bb3ed46-836e-42c0-9840-802d63a78467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:43.553267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 557/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:43.826858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35972f9b-e5b3-4f9a-8632-3b67d0493505 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:43.865256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:43.934626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35972f9b-e5b3-4f9a-8632-3b67d0493505 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:43.971404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58551fd-ef30-4cc3-9795-a5e28ac211ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:43.972052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58551fd-ef30-4cc3-9795-a5e28ac211ff None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:43.972334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58551fd-ef30-4cc3-9795-a5e28ac211ff None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:43.972610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58551fd-ef30-4cc3-9795-a5e28ac211ff None admin] PATH_INFO: `/v3/roles/3ba2e6e2ec814831bb3bc254484024d2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:43.974096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58551fd-ef30-4cc3-9795-a5e28ac211ff None admin] RBAC: Authorizing `identity:get_role(role_id=3ba2e6e2ec814831bb3bc254484024d2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:43.975497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58551fd-ef30-4cc3-9795-a5e28ac211ff None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:43.976903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 556/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:43 2022] GET /identity/v3/roles/3ba2e6e2ec814831bb3bc254484024d2 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:43.983066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3ed46-836e-42c0-9840-802d63a78467 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:44.047072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:44.090600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3ed46-836e-42c0-9840-802d63a78467 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:44.127322 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2eaa6-2a97-4590-94c6-43d3a0df931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:44.127968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2eaa6-2a97-4590-94c6-43d3a0df931c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:44.128250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2eaa6-2a97-4590-94c6-43d3a0df931c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:44.128526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2eaa6-2a97-4590-94c6-43d3a0df931c None admin] PATH_INFO: `/v3/users/9ae8f22217b847d4a6c7b5e67d9f3771` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:44.144069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2eaa6-2a97-4590-94c6-43d3a0df931c None admin] RBAC: Authorizing `identity:get_user(user_id=9ae8f22217b847d4a6c7b5e67d9f3771)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:44.145528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2eaa6-2a97-4590-94c6-43d3a0df931c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:44.147262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 558/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:43 2022] GET /identity/v3/users/9ae8f22217b847d4a6c7b5e67d9f3771 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:44.153327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58551fd-ef30-4cc3-9795-a5e28ac211ff None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:44.258592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58551fd-ef30-4cc3-9795-a5e28ac211ff None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:44.261031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:44.296446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fef48-e50d-4a41-bf17-786f17047bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:44.297260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fef48-e50d-4a41-bf17-786f17047bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:44.297958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fef48-e50d-4a41-bf17-786f17047bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:44.298493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fef48-e50d-4a41-bf17-786f17047bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:44.366860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fef48-e50d-4a41-bf17-786f17047bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:44.368215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fef48-e50d-4a41-bf17-786f17047bc3 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:44.472128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 557/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:44.478230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2eaa6-2a97-4590-94c6-43d3a0df931c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:44.579662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2eaa6-2a97-4590-94c6-43d3a0df931c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:44.596886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:44.613846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbc5b0-8684-4a65-8df4-829ce7762dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:44.614474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbc5b0-8684-4a65-8df4-829ce7762dad None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:44.614755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbc5b0-8684-4a65-8df4-829ce7762dad None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:44.615032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbc5b0-8684-4a65-8df4-829ce7762dad None admin] PATH_INFO: `/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:44.616139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbc5b0-8684-4a65-8df4-829ce7762dad None admin] RBAC: Authorizing `identity:get_project(project_id=b7a59a5ed18c42c8ad1aeaa997309510)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:44.617661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbc5b0-8684-4a65-8df4-829ce7762dad None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:44.619290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 559/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:44 2022] GET /identity/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:44.625489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fef48-e50d-4a41-bf17-786f17047bc3 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:44.628587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:44.727218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fef48-e50d-4a41-bf17-786f17047bc3 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:44.761585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f01f4-0d2f-4283-9406-5e5bbdc9e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:44.762211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f01f4-0d2f-4283-9406-5e5bbdc9e6df None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:44.762489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f01f4-0d2f-4283-9406-5e5bbdc9e6df None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:44.762758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f01f4-0d2f-4283-9406-5e5bbdc9e6df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:44.763474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f01f4-0d2f-4283-9406-5e5bbdc9e6df None admin] RBAC: Adding query filter params (role.id=3ba2e6e2ec814831bb3bc254484024d2, scope.project.id=b7a59a5ed18c42c8ad1aeaa997309510, user.id=9ae8f22217b847d4a6c7b5e67d9f3771) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:44.763782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f01f4-0d2f-4283-9406-5e5bbdc9e6df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:44.765282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f01f4-0d2f-4283-9406-5e5bbdc9e6df None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:44.771201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 558/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:44 2022] GET /identity/v3/role_assignments?user.id=9ae8f22217b847d4a6c7b5e67d9f3771&scope.project.id=b7a59a5ed18c42c8ad1aeaa997309510&role.id=3ba2e6e2ec814831bb3bc254484024d2 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:46.669440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f4deb-76d7-438e-a62a-e0692ad18c19 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:46.670019 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f4deb-76d7-438e-a62a-e0692ad18c19 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:46.670019 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f4deb-76d7-438e-a62a-e0692ad18c19 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:46.671370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 560/1118] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:46.677283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe42744-c4bf-4201-8b2f-02f388b1e87e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:46.677825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe42744-c4bf-4201-8b2f-02f388b1e87e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:46.677912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe42744-c4bf-4201-8b2f-02f388b1e87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:46.697033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5fe42744-c4bf-4201-8b2f-02f388b1e87e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:46.698298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5fe42744-c4bf-4201-8b2f-02f388b1e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:46.765702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:46.771933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 559/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:47.040754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f4deb-76d7-438e-a62a-e0692ad18c19 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:47.147500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f4deb-76d7-438e-a62a-e0692ad18c19 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:47.185559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1577bb1-7f7d-4780-a6df-23c7f3cb74cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:47.186347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577bb1-7f7d-4780-a6df-23c7f3cb74cc None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:47.186628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577bb1-7f7d-4780-a6df-23c7f3cb74cc None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:47.186901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577bb1-7f7d-4780-a6df-23c7f3cb74cc None admin] PATH_INFO: `/v3/roles/3ba2e6e2ec814831bb3bc254484024d2` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:47.188277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1577bb1-7f7d-4780-a6df-23c7f3cb74cc None admin] RBAC: Authorizing `identity:get_role(role_id=3ba2e6e2ec814831bb3bc254484024d2)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:47.190256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1577bb1-7f7d-4780-a6df-23c7f3cb74cc None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:47.191593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 561/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:47 2022] GET /identity/v3/roles/3ba2e6e2ec814831bb3bc254484024d2 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:47.197883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe42744-c4bf-4201-8b2f-02f388b1e87e None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:47.300521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe42744-c4bf-4201-8b2f-02f388b1e87e None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:47.336995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6e676-9121-4118-96e9-a175c26e2ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:47.337630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6e676-9121-4118-96e9-a175c26e2ead None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:47.338217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6e676-9121-4118-96e9-a175c26e2ead None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:47.338493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6e676-9121-4118-96e9-a175c26e2ead None admin] PATH_INFO: `/v3/users/9ae8f22217b847d4a6c7b5e67d9f3771` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:47.339628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6e676-9121-4118-96e9-a175c26e2ead None admin] RBAC: Authorizing `identity:get_user(user_id=9ae8f22217b847d4a6c7b5e67d9f3771)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:47.341067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6e676-9121-4118-96e9-a175c26e2ead None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:47.342701 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 560/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:47 2022] GET /identity/v3/users/9ae8f22217b847d4a6c7b5e67d9f3771 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:47.348700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1577bb1-7f7d-4780-a6df-23c7f3cb74cc None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:47.404586 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:47.457595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1577bb1-7f7d-4780-a6df-23c7f3cb74cc None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:47.493538 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69022b-5931-41ad-b4db-16dd41299678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:47.494182 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69022b-5931-41ad-b4db-16dd41299678 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:47.494454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69022b-5931-41ad-b4db-16dd41299678 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:47.494724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69022b-5931-41ad-b4db-16dd41299678 None admin] PATH_INFO: `/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:47.495838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69022b-5931-41ad-b4db-16dd41299678 None admin] RBAC: Authorizing `identity:get_project(project_id=b7a59a5ed18c42c8ad1aeaa997309510)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:47.497271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69022b-5931-41ad-b4db-16dd41299678 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:47.498971 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 562/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:47 2022] GET /identity/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:47.505685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6e676-9121-4118-96e9-a175c26e2ead None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:47.576775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:47.612909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6e676-9121-4118-96e9-a175c26e2ead None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:47.651066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e5c1c-2745-4f54-88ee-9a689b018690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:47.651927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e5c1c-2745-4f54-88ee-9a689b018690 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:47.652230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e5c1c-2745-4f54-88ee-9a689b018690 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:47.652510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e5c1c-2745-4f54-88ee-9a689b018690 None admin] PATH_INFO: `/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510/users/9ae8f22217b847d4a6c7b5e67d9f3771/roles/3ba2e6e2ec814831bb3bc254484024d2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:47.654842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e5c1c-2745-4f54-88ee-9a689b018690 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7a59a5ed18c42c8ad1aeaa997309510, user_id=9ae8f22217b847d4a6c7b5e67d9f3771, role_id=3ba2e6e2ec814831bb3bc254484024d2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:47.656294 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e5c1c-2745-4f54-88ee-9a689b018690 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:47.761855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 561/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:09:47 2022] PUT /identity/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510/users/9ae8f22217b847d4a6c7b5e67d9f3771/roles/3ba2e6e2ec814831bb3bc254484024d2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:09:49.728145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16cfb-e60b-450b-be57-eed1186182bf None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:49.728680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16cfb-e60b-450b-be57-eed1186182bf None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:49.728768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16cfb-e60b-450b-be57-eed1186182bf None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:49.730510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 563/1124] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:49.736157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d9f9c-102a-4725-8fc3-64c8950b756f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:49.736602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d9f9c-102a-4725-8fc3-64c8950b756f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:49.736710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d9f9c-102a-4725-8fc3-64c8950b756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:49.756074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1d2d9f9c-102a-4725-8fc3-64c8950b756f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:49.757294 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1d2d9f9c-102a-4725-8fc3-64c8950b756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:49.839145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 562/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:50.106699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16cfb-e60b-450b-be57-eed1186182bf None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:50.207674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16cfb-e60b-450b-be57-eed1186182bf None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:50.227897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:50.241263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937fe0a-fa36-4c87-9b0d-fb9f250eba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:50.246544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937fe0a-fa36-4c87-9b0d-fb9f250eba10 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:50.246544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937fe0a-fa36-4c87-9b0d-fb9f250eba10 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:50.246544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937fe0a-fa36-4c87-9b0d-fb9f250eba10 None admin] PATH_INFO: `/v3/roles/3ba2e6e2ec814831bb3bc254484024d2` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:50.246544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937fe0a-fa36-4c87-9b0d-fb9f250eba10 None admin] RBAC: Authorizing `identity:get_role(role_id=3ba2e6e2ec814831bb3bc254484024d2)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:50.246544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937fe0a-fa36-4c87-9b0d-fb9f250eba10 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:50.246544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 564/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:50 2022] GET /identity/v3/roles/3ba2e6e2ec814831bb3bc254484024d2 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:50.252923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d9f9c-102a-4725-8fc3-64c8950b756f None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:50.308977 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:50.352781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d9f9c-102a-4725-8fc3-64c8950b756f None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:50.387849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17724185-4323-44b9-a6f0-95d306861f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:50.388397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17724185-4323-44b9-a6f0-95d306861f94 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:50.388676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17724185-4323-44b9-a6f0-95d306861f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:50.388953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17724185-4323-44b9-a6f0-95d306861f94 None admin] PATH_INFO: `/v3/users/9ae8f22217b847d4a6c7b5e67d9f3771` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:50.390104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17724185-4323-44b9-a6f0-95d306861f94 None admin] RBAC: Authorizing `identity:get_user(user_id=9ae8f22217b847d4a6c7b5e67d9f3771)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:50.391538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17724185-4323-44b9-a6f0-95d306861f94 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:50.393185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 563/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:50 2022] GET /identity/v3/users/9ae8f22217b847d4a6c7b5e67d9f3771 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:50.399014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937fe0a-fa36-4c87-9b0d-fb9f250eba10 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:50.497354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937fe0a-fa36-4c87-9b0d-fb9f250eba10 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:50.531649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b1913-a329-4474-adcc-b2ddabc1944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:50.532258 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b1913-a329-4474-adcc-b2ddabc1944e None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:50.532540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b1913-a329-4474-adcc-b2ddabc1944e None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:50.532847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b1913-a329-4474-adcc-b2ddabc1944e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:50.589082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:50.602316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b1913-a329-4474-adcc-b2ddabc1944e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:50.603762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b1913-a329-4474-adcc-b2ddabc1944e None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:50.703418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 565/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:50.709435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17724185-4323-44b9-a6f0-95d306861f94 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:50.808925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17724185-4323-44b9-a6f0-95d306861f94 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:50.833098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:50.843493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d3b35-6740-4839-a82c-8bb2ffd39b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:50.844122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d3b35-6740-4839-a82c-8bb2ffd39b9c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:50.844402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d3b35-6740-4839-a82c-8bb2ffd39b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:50.844769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d3b35-6740-4839-a82c-8bb2ffd39b9c None admin] PATH_INFO: `/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:50.846296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d3b35-6740-4839-a82c-8bb2ffd39b9c None admin] RBAC: Authorizing `identity:get_project(project_id=b7a59a5ed18c42c8ad1aeaa997309510)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:50.847861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d3b35-6740-4839-a82c-8bb2ffd39b9c None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:50.849384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 564/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:50 2022] GET /identity/v3/projects/b7a59a5ed18c42c8ad1aeaa997309510 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:50.855770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b1913-a329-4474-adcc-b2ddabc1944e None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:50.945241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:50.957330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b1913-a329-4474-adcc-b2ddabc1944e None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:50.991754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652a81a-d614-46e2-8033-9c2aa055a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:50.992353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652a81a-d614-46e2-8033-9c2aa055a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:50.992634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652a81a-d614-46e2-8033-9c2aa055a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:50.992908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652a81a-d614-46e2-8033-9c2aa055a4d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:50.993629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652a81a-d614-46e2-8033-9c2aa055a4d1 None admin] RBAC: Adding query filter params (role.id=3ba2e6e2ec814831bb3bc254484024d2, scope.project.id=b7a59a5ed18c42c8ad1aeaa997309510, user.id=9ae8f22217b847d4a6c7b5e67d9f3771) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:50.993963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652a81a-d614-46e2-8033-9c2aa055a4d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:50.995379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652a81a-d614-46e2-8033-9c2aa055a4d1 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:51.001160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 566/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:50 2022] GET /identity/v3/role_assignments?user.id=9ae8f22217b847d4a6c7b5e67d9f3771&scope.project.id=b7a59a5ed18c42c8ad1aeaa997309510&role.id=3ba2e6e2ec814831bb3bc254484024d2 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:52.958465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebca39-dc37-4c6f-845a-4f0100326d67 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:52.958979 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebca39-dc37-4c6f-845a-4f0100326d67 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:52.959089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebca39-dc37-4c6f-845a-4f0100326d67 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:52.960362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 565/1131] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:52.965427 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3ce7c-6c76-4a94-9122-f16be777e2b1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:52.965814 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3ce7c-6c76-4a94-9122-f16be777e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:52.966016 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3ce7c-6c76-4a94-9122-f16be777e2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:52.983665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-80f3ce7c-6c76-4a94-9122-f16be777e2b1 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:52.984840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-80f3ce7c-6c76-4a94-9122-f16be777e2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:53.049098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 567/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:53.313733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebca39-dc37-4c6f-845a-4f0100326d67 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:53.425561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebca39-dc37-4c6f-845a-4f0100326d67 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:53.458215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ff6d6-5be5-4aee-9030-adde3258cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:53.458825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ff6d6-5be5-4aee-9030-adde3258cac0 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:53.459104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ff6d6-5be5-4aee-9030-adde3258cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:53.459377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ff6d6-5be5-4aee-9030-adde3258cac0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:53.460476 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ff6d6-5be5-4aee-9030-adde3258cac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:53.462350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ff6d6-5be5-4aee-9030-adde3258cac0 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:53.463901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 566/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:53.469762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3ce7c-6c76-4a94-9122-f16be777e2b1 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:53.548092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:53.566857 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3ce7c-6c76-4a94-9122-f16be777e2b1 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:53.606834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac51769-fe2b-41bc-9cf5-784287e90584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:53.607442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51769-fe2b-41bc-9cf5-784287e90584 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:53.607730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51769-fe2b-41bc-9cf5-784287e90584 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:53.608003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51769-fe2b-41bc-9cf5-784287e90584 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:53.608654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac51769-fe2b-41bc-9cf5-784287e90584 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:53.610142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac51769-fe2b-41bc-9cf5-784287e90584 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:53.711963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 568/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:09:53 2022] POST /identity/v3/projects => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:55.651825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d017f-c7d0-41a6-bae0-c92dc775a5b3 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:55.652450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d017f-c7d0-41a6-bae0-c92dc775a5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:55.652450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d017f-c7d0-41a6-bae0-c92dc775a5b3 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:55.653717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 567/1135] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:55.659898 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72dc4c-1923-492d-9d07-a7c284ef62fb None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:55.660375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72dc4c-1923-492d-9d07-a7c284ef62fb None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:55.660490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72dc4c-1923-492d-9d07-a7c284ef62fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:55.680554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-fd72dc4c-1923-492d-9d07-a7c284ef62fb None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:55.681783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-fd72dc4c-1923-492d-9d07-a7c284ef62fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:55.748431 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 569/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:09:56.020928 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d017f-c7d0-41a6-bae0-c92dc775a5b3 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:56.081944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:56.123996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d017f-c7d0-41a6-bae0-c92dc775a5b3 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:56.161971 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cabcc6-dac4-4eb8-8867-9d6268baacf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:56.162598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cabcc6-dac4-4eb8-8867-9d6268baacf2 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:56.162875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cabcc6-dac4-4eb8-8867-9d6268baacf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:56.163146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cabcc6-dac4-4eb8-8867-9d6268baacf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:56.164246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cabcc6-dac4-4eb8-8867-9d6268baacf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:56.165697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cabcc6-dac4-4eb8-8867-9d6268baacf2 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:56.167300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 568/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:09:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:09:56.173229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72dc4c-1923-492d-9d07-a7c284ef62fb None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:56.235905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:56.275136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72dc4c-1923-492d-9d07-a7c284ef62fb None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:56.311907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a717f-c914-4c69-a882-ae6df1cc0a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:56.312516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a717f-c914-4c69-a882-ae6df1cc0a0a None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:56.312793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a717f-c914-4c69-a882-ae6df1cc0a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:56.313055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a717f-c914-4c69-a882-ae6df1cc0a0a None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:56.313810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a717f-c914-4c69-a882-ae6df1cc0a0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:56.315887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a717f-c914-4c69-a882-ae6df1cc0a0a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:56.436254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 570/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:09:56 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:09:58.420352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c0ae-126a-426a-9bb1-e93763cfb988 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:58.420909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c0ae-126a-426a-9bb1-e93763cfb988 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:58.420909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c0ae-126a-426a-9bb1-e93763cfb988 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:58.422274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 569/1139] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:58.428204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c7ed9-bff9-4c38-92f7-8c9bd11cdb5a None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:58.428665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c7ed9-bff9-4c38-92f7-8c9bd11cdb5a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:58.428758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c7ed9-bff9-4c38-92f7-8c9bd11cdb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:58.447756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-5b5c7ed9-bff9-4c38-92f7-8c9bd11cdb5a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:58.448962 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-5b5c7ed9-bff9-4c38-92f7-8c9bd11cdb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:58.517557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 571/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:09:58.793906 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952c0ae-126a-426a-9bb1-e93763cfb988 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:58.896792 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952c0ae-126a-426a-9bb1-e93763cfb988 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:58.922498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:58.930456 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc035be-41b2-4ac2-8d66-5a739ca1e19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:58.931078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc035be-41b2-4ac2-8d66-5a739ca1e19e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:58.931360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc035be-41b2-4ac2-8d66-5a739ca1e19e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:58.931638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc035be-41b2-4ac2-8d66-5a739ca1e19e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:58.941524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc035be-41b2-4ac2-8d66-5a739ca1e19e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-8fc035be-41b2-4ac2-8d66-5a739ca1e19e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:09:58.946755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:09:58.947851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:09:58.950332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 570/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:09:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:09:58.954234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c7ed9-bff9-4c38-92f7-8c9bd11cdb5a None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:59.002031 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:59.053219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c7ed9-bff9-4c38-92f7-8c9bd11cdb5a None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:59.086756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea0a2a-f9e5-4dd9-8d92-1902c3e5409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:59.087356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea0a2a-f9e5-4dd9-8d92-1902c3e5409b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:59.087630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea0a2a-f9e5-4dd9-8d92-1902c3e5409b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:59.087902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea0a2a-f9e5-4dd9-8d92-1902c3e5409b None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:59.088565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea0a2a-f9e5-4dd9-8d92-1902c3e5409b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:59.088869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea0a2a-f9e5-4dd9-8d92-1902c3e5409b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:59.090252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea0a2a-f9e5-4dd9-8d92-1902c3e5409b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:59.098883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 572/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:09:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:59.104990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc035be-41b2-4ac2-8d66-5a739ca1e19e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:59.206915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc035be-41b2-4ac2-8d66-5a739ca1e19e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:59.240486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a670e-595a-40b7-8f66-53cf727c933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:59.241109 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a670e-595a-40b7-8f66-53cf727c933e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:59.241390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a670e-595a-40b7-8f66-53cf727c933e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:59.241691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a670e-595a-40b7-8f66-53cf727c933e None admin] PATH_INFO: `/v3/users/460c92a0e0ab40a4a778382607ffac5a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:59.254528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a670e-595a-40b7-8f66-53cf727c933e None admin] RBAC: Authorizing `identity:get_user(user_id=460c92a0e0ab40a4a778382607ffac5a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:59.255962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a670e-595a-40b7-8f66-53cf727c933e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:59.257566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 571/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:09:59 2022] GET /identity/v3/users/460c92a0e0ab40a4a778382607ffac5a => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:59.263500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea0a2a-f9e5-4dd9-8d92-1902c3e5409b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:59.360101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea0a2a-f9e5-4dd9-8d92-1902c3e5409b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:59.372411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:59.392540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc1ce5-0352-40c0-b628-817741ed97dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:59.393140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc1ce5-0352-40c0-b628-817741ed97dc None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:59.393419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc1ce5-0352-40c0-b628-817741ed97dc None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:59.393717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc1ce5-0352-40c0-b628-817741ed97dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:59.458764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc1ce5-0352-40c0-b628-817741ed97dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:59.460207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc1ce5-0352-40c0-b628-817741ed97dc None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:59.558513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 573/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:09:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:09:59.564723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a670e-595a-40b7-8f66-53cf727c933e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:59.612140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:59.664600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a670e-595a-40b7-8f66-53cf727c933e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:59.702502 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c898173-5aba-45a7-b127-418c5d7d2b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:59.703133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c898173-5aba-45a7-b127-418c5d7d2b93 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:59.703409 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c898173-5aba-45a7-b127-418c5d7d2b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:59.703679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c898173-5aba-45a7-b127-418c5d7d2b93 None admin] PATH_INFO: `/v3/projects/81aa3c06578c4a9cb375371d1e1bc389` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:59.705337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c898173-5aba-45a7-b127-418c5d7d2b93 None admin] RBAC: Authorizing `identity:get_project(project_id=81aa3c06578c4a9cb375371d1e1bc389)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:59.706870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c898173-5aba-45a7-b127-418c5d7d2b93 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:59.708493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 572/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:09:59 2022] GET /identity/v3/projects/81aa3c06578c4a9cb375371d1e1bc389 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:09:59.715284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc1ce5-0352-40c0-b628-817741ed97dc None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:59.728654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:59.813489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc1ce5-0352-40c0-b628-817741ed97dc None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:59.848429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9189b4f-153e-4ebf-9efc-885579a1daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:59.849036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9189b4f-153e-4ebf-9efc-885579a1daa1 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:59.849318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9189b4f-153e-4ebf-9efc-885579a1daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:59.849592 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9189b4f-153e-4ebf-9efc-885579a1daa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:59.850343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9189b4f-153e-4ebf-9efc-885579a1daa1 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=81aa3c06578c4a9cb375371d1e1bc389, user.id=460c92a0e0ab40a4a778382607ffac5a) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:09:59.850652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9189b4f-153e-4ebf-9efc-885579a1daa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:59.852077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9189b4f-153e-4ebf-9efc-885579a1daa1 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:59.857518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 574/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:09:59 2022] GET /identity/v3/role_assignments?user.id=460c92a0e0ab40a4a778382607ffac5a&scope.project.id=81aa3c06578c4a9cb375371d1e1bc389&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:01.748802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd279-d5d8-4f13-b6e9-4d6457e8a41e None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:01.749341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd279-d5d8-4f13-b6e9-4d6457e8a41e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:01.749341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd279-d5d8-4f13-b6e9-4d6457e8a41e None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:01.750730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 573/1147] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:01.755889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686025-e6bc-4608-ad6b-ceba535f820d None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:01.756305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686025-e6bc-4608-ad6b-ceba535f820d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:01.756438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686025-e6bc-4608-ad6b-ceba535f820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:01.774696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-bc686025-e6bc-4608-ad6b-ceba535f820d None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:01.775867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bc686025-e6bc-4608-ad6b-ceba535f820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:01.842831 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 575/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:10:02.115050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dd279-d5d8-4f13-b6e9-4d6457e8a41e None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:02.214516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dd279-d5d8-4f13-b6e9-4d6457e8a41e None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:02.227908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:02.246958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb1378-f8be-4348-8c7f-1a35177df734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:02.247600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb1378-f8be-4348-8c7f-1a35177df734 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:02.247885 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb1378-f8be-4348-8c7f-1a35177df734 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:02.248157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb1378-f8be-4348-8c7f-1a35177df734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:02.258490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb1378-f8be-4348-8c7f-1a35177df734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-c7bb1378-f8be-4348-8c7f-1a35177df734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:10:02.263421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:10:02.264498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:10:02.265369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 574/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:10:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:10:02.271518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686025-e6bc-4608-ad6b-ceba535f820d None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:02.279476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:02.369050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686025-e6bc-4608-ad6b-ceba535f820d None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:02.403175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ba561-5073-43fc-a4f0-03bae690cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:02.403779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ba561-5073-43fc-a4f0-03bae690cc8b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:02.404057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ba561-5073-43fc-a4f0-03bae690cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:02.404328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ba561-5073-43fc-a4f0-03bae690cc8b None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:02.404992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ba561-5073-43fc-a4f0-03bae690cc8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:10:02.405328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ba561-5073-43fc-a4f0-03bae690cc8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:02.406677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ba561-5073-43fc-a4f0-03bae690cc8b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:02.415435 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 576/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:10:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:02.422002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb1378-f8be-4348-8c7f-1a35177df734 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:02.520084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb1378-f8be-4348-8c7f-1a35177df734 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:02.558598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1fbb7-fd50-4d64-967d-277f8eccd111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:02.559230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1fbb7-fd50-4d64-967d-277f8eccd111 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:02.559560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1fbb7-fd50-4d64-967d-277f8eccd111 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:02.559833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1fbb7-fd50-4d64-967d-277f8eccd111 None admin] PATH_INFO: `/v3/users/460c92a0e0ab40a4a778382607ffac5a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:02.561077 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1fbb7-fd50-4d64-967d-277f8eccd111 None admin] RBAC: Authorizing `identity:get_user(user_id=460c92a0e0ab40a4a778382607ffac5a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:02.562751 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1fbb7-fd50-4d64-967d-277f8eccd111 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:02.564980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 575/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:10:02 2022] GET /identity/v3/users/460c92a0e0ab40a4a778382607ffac5a => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:02.571052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ba561-5073-43fc-a4f0-03bae690cc8b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:02.641693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:02.679674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ba561-5073-43fc-a4f0-03bae690cc8b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:02.714943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612e3d5-04e4-4ae5-be6d-ae5a9e912ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:02.715581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e3d5-04e4-4ae5-be6d-ae5a9e912ebc None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:02.715859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e3d5-04e4-4ae5-be6d-ae5a9e912ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:02.716132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e3d5-04e4-4ae5-be6d-ae5a9e912ebc None admin] PATH_INFO: `/v3/projects/81aa3c06578c4a9cb375371d1e1bc389` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:02.717282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612e3d5-04e4-4ae5-be6d-ae5a9e912ebc None admin] RBAC: Authorizing `identity:get_project(project_id=81aa3c06578c4a9cb375371d1e1bc389)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:02.718766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612e3d5-04e4-4ae5-be6d-ae5a9e912ebc None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:02.721024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 577/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:10:02 2022] GET /identity/v3/projects/81aa3c06578c4a9cb375371d1e1bc389 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:02.727408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1fbb7-fd50-4d64-967d-277f8eccd111 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:02.774050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:02.835451 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1fbb7-fd50-4d64-967d-277f8eccd111 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:02.870394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca777-3e36-4ebb-9686-e2c5e69182ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:02.871054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca777-3e36-4ebb-9686-e2c5e69182ab None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:02.871330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca777-3e36-4ebb-9686-e2c5e69182ab None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:02.871602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca777-3e36-4ebb-9686-e2c5e69182ab None admin] PATH_INFO: `/v3/projects/81aa3c06578c4a9cb375371d1e1bc389/users/460c92a0e0ab40a4a778382607ffac5a/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:02.873518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eca777-3e36-4ebb-9686-e2c5e69182ab None admin] RBAC: Authorizing `identity:create_grant(project_id=81aa3c06578c4a9cb375371d1e1bc389, user_id=460c92a0e0ab40a4a778382607ffac5a, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:02.875002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eca777-3e36-4ebb-9686-e2c5e69182ab None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:02.973855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 576/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:10:02 2022] PUT /identity/v3/projects/81aa3c06578c4a9cb375371d1e1bc389/users/460c92a0e0ab40a4a778382607ffac5a/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:10:04.841570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27984ace-e5c1-4b2d-a0d1-0a7fce3829ad None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:04.842044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27984ace-e5c1-4b2d-a0d1-0a7fce3829ad None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:04.842183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27984ace-e5c1-4b2d-a0d1-0a7fce3829ad None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:04.843609 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 578/1154] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:04.849401 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9201abe-eb6b-4a49-bada-ab6a1fde9311 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:04.849861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9201abe-eb6b-4a49-bada-ab6a1fde9311 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:04.849966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9201abe-eb6b-4a49-bada-ab6a1fde9311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:04.868280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-d9201abe-eb6b-4a49-bada-ab6a1fde9311 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:04.869465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d9201abe-eb6b-4a49-bada-ab6a1fde9311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:04.933304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 577/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:10:05.203139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27984ace-e5c1-4b2d-a0d1-0a7fce3829ad None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:05.306608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27984ace-e5c1-4b2d-a0d1-0a7fce3829ad None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:05.341236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88dd59-3327-4b30-823c-6164c1f1cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:05.342000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88dd59-3327-4b30-823c-6164c1f1cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:05.342291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88dd59-3327-4b30-823c-6164c1f1cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:05.342569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88dd59-3327-4b30-823c-6164c1f1cbc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:05.345333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:05.354346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88dd59-3327-4b30-823c-6164c1f1cbc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-3f88dd59-3327-4b30-823c-6164c1f1cbc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:10:05.359243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:10:05.360432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:10:05.362131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 579/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:10:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:10:05.367302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9201abe-eb6b-4a49-bada-ab6a1fde9311 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:05.399254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:05.464573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9201abe-eb6b-4a49-bada-ab6a1fde9311 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:05.498856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c05d0a-0179-4d21-ab28-4e46e7e2b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:05.499469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05d0a-0179-4d21-ab28-4e46e7e2b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:05.499748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05d0a-0179-4d21-ab28-4e46e7e2b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:05.500019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05d0a-0179-4d21-ab28-4e46e7e2b9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:05.500690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c05d0a-0179-4d21-ab28-4e46e7e2b9f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:10:05.500993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c05d0a-0179-4d21-ab28-4e46e7e2b9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:05.502433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c05d0a-0179-4d21-ab28-4e46e7e2b9f7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:05.511172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 578/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:05.517010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88dd59-3327-4b30-823c-6164c1f1cbc8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:05.616850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88dd59-3327-4b30-823c-6164c1f1cbc8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:05.649851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3c5b4-92dc-4a3d-851c-75ade0d73d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:05.650496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3c5b4-92dc-4a3d-851c-75ade0d73d55 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:05.650785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3c5b4-92dc-4a3d-851c-75ade0d73d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:05.651057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3c5b4-92dc-4a3d-851c-75ade0d73d55 None admin] PATH_INFO: `/v3/users/460c92a0e0ab40a4a778382607ffac5a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:05.652220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3c5b4-92dc-4a3d-851c-75ade0d73d55 None admin] RBAC: Authorizing `identity:get_user(user_id=460c92a0e0ab40a4a778382607ffac5a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:05.653802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3c5b4-92dc-4a3d-851c-75ade0d73d55 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:05.655383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 580/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:10:05 2022] GET /identity/v3/users/460c92a0e0ab40a4a778382607ffac5a => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:05.662057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c05d0a-0179-4d21-ab28-4e46e7e2b9f7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:05.752817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:05.758915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c05d0a-0179-4d21-ab28-4e46e7e2b9f7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:05.792236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa04f18-a680-443a-8e48-7c5ae43ca656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:05.792849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04f18-a680-443a-8e48-7c5ae43ca656 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:05.793130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04f18-a680-443a-8e48-7c5ae43ca656 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:05.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04f18-a680-443a-8e48-7c5ae43ca656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:05.860214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa04f18-a680-443a-8e48-7c5ae43ca656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:05.862247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa04f18-a680-443a-8e48-7c5ae43ca656 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:05.949525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:05.956457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 579/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:10:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:05.962577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3c5b4-92dc-4a3d-851c-75ade0d73d55 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:06.025407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:06.063524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3c5b4-92dc-4a3d-851c-75ade0d73d55 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:06.096954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c71a0-f374-4599-bb8e-07b1bab44b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:06.097572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c71a0-f374-4599-bb8e-07b1bab44b71 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:06.097876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c71a0-f374-4599-bb8e-07b1bab44b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:06.098147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c71a0-f374-4599-bb8e-07b1bab44b71 None admin] PATH_INFO: `/v3/projects/81aa3c06578c4a9cb375371d1e1bc389` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:06.099242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c71a0-f374-4599-bb8e-07b1bab44b71 None admin] RBAC: Authorizing `identity:get_project(project_id=81aa3c06578c4a9cb375371d1e1bc389)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:06.100648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c71a0-f374-4599-bb8e-07b1bab44b71 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:06.102298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 581/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:10:05 2022] GET /identity/v3/projects/81aa3c06578c4a9cb375371d1e1bc389 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:06.108339 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa04f18-a680-443a-8e48-7c5ae43ca656 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:06.203631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa04f18-a680-443a-8e48-7c5ae43ca656 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:06.237110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92375e63-f77a-472b-812e-85732f290a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:06.237724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92375e63-f77a-472b-812e-85732f290a97 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:06.238006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92375e63-f77a-472b-812e-85732f290a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:06.238284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92375e63-f77a-472b-812e-85732f290a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:06.239003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92375e63-f77a-472b-812e-85732f290a97 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=81aa3c06578c4a9cb375371d1e1bc389, user.id=460c92a0e0ab40a4a778382607ffac5a) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:10:06.239310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92375e63-f77a-472b-812e-85732f290a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:06.240731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92375e63-f77a-472b-812e-85732f290a97 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:06.246379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 580/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:10:06 2022] GET /identity/v3/role_assignments?user.id=460c92a0e0ab40a4a778382607ffac5a&scope.project.id=81aa3c06578c4a9cb375371d1e1bc389&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:08.155514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07eb9-4cee-464c-89dc-80b28ba600f5 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:08.156026 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07eb9-4cee-464c-89dc-80b28ba600f5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:08.156026 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07eb9-4cee-464c-89dc-80b28ba600f5 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:08.157308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 582/1162] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:08.162652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b9dbe-6131-41f7-837e-9f31bc49a4b6 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:08.163071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b9dbe-6131-41f7-837e-9f31bc49a4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:08.163202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b9dbe-6131-41f7-837e-9f31bc49a4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:08.182086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-240b9dbe-6131-41f7-837e-9f31bc49a4b6 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:08.183300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-240b9dbe-6131-41f7-837e-9f31bc49a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:08.248731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:08.263201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 581/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:10:08.535912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a07eb9-4cee-464c-89dc-80b28ba600f5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:08.640185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a07eb9-4cee-464c-89dc-80b28ba600f5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:08.669262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:08.674650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696f54-cd60-413a-8596-7ace5ca05b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:08.675252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696f54-cd60-413a-8596-7ace5ca05b25 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:08.675533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696f54-cd60-413a-8596-7ace5ca05b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:08.675801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91696f54-cd60-413a-8596-7ace5ca05b25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:08.751444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91696f54-cd60-413a-8596-7ace5ca05b25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:08.752899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91696f54-cd60-413a-8596-7ace5ca05b25 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:08.851012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 583/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:10:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:10:08.856993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b9dbe-6131-41f7-837e-9f31bc49a4b6 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:08.953218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b9dbe-6131-41f7-837e-9f31bc49a4b6 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:08.987088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14386-ca4d-4ba0-a767-1a9dee4dd6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:08.987708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14386-ca4d-4ba0-a767-1a9dee4dd6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:08.987983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14386-ca4d-4ba0-a767-1a9dee4dd6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:08.988252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14386-ca4d-4ba0-a767-1a9dee4dd6b9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:08.994703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de14386-ca4d-4ba0-a767-1a9dee4dd6b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:08.996133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de14386-ca4d-4ba0-a767-1a9dee4dd6b9 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-0de14386-ca4d-4ba0-a767-1a9dee4dd6b9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:10:09.007689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:10:09.009115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:10:09.010153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 582/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 31 19:10:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:10:09.014759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696f54-cd60-413a-8596-7ace5ca05b25 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:09.045104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:09.112875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91696f54-cd60-413a-8596-7ace5ca05b25 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:09.145943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e08a98-4289-4071-bafd-8bce54fcf08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:09.146543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08a98-4289-4071-bafd-8bce54fcf08b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:09.146827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08a98-4289-4071-bafd-8bce54fcf08b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:09.147102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08a98-4289-4071-bafd-8bce54fcf08b None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:09.147742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e08a98-4289-4071-bafd-8bce54fcf08b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:10:09.148048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e08a98-4289-4071-bafd-8bce54fcf08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:09.149404 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e08a98-4289-4071-bafd-8bce54fcf08b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:09.156421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 584/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 31 19:10:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:11.051985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d65b2-2eab-43aa-9e1c-d74daf1910be None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:11.052553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d65b2-2eab-43aa-9e1c-d74daf1910be None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:11.052671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d65b2-2eab-43aa-9e1c-d74daf1910be None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:11.054057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 583/1167] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:11.059398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32964216-05be-41fe-afa0-fc5e2d36bd01 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:11.059820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32964216-05be-41fe-afa0-fc5e2d36bd01 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:11.059959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32964216-05be-41fe-afa0-fc5e2d36bd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:11.078234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-32964216-05be-41fe-afa0-fc5e2d36bd01 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:11.079376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-32964216-05be-41fe-afa0-fc5e2d36bd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:11.143251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 585/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:10:11.413444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d65b2-2eab-43aa-9e1c-d74daf1910be None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:11.462149 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:11.511122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d65b2-2eab-43aa-9e1c-d74daf1910be None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:11.543324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f4d7d-98fd-4020-9daa-e387539ab4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:11.543918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4d7d-98fd-4020-9daa-e387539ab4b6 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:11.544195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4d7d-98fd-4020-9daa-e387539ab4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:11.544463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4d7d-98fd-4020-9daa-e387539ab4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:11.545124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f4d7d-98fd-4020-9daa-e387539ab4b6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:11.546576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f4d7d-98fd-4020-9daa-e387539ab4b6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:11.624994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 584/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Wed Aug 31 19:10:11 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:10:13.557701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71563-3d53-4338-a065-1e918f4418d5 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:13.558261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71563-3d53-4338-a065-1e918f4418d5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:13.558261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71563-3d53-4338-a065-1e918f4418d5 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:13.559627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 586/1170] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:13.564762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a239e-9195-483c-8253-440f48a4f805 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:13.565205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a239e-9195-483c-8253-440f48a4f805 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:13.565323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a239e-9195-483c-8253-440f48a4f805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:13.583984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-a19a239e-9195-483c-8253-440f48a4f805 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:13.585171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a19a239e-9195-483c-8253-440f48a4f805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:13.649768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 585/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:10:13.924913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c71563-3d53-4338-a065-1e918f4418d5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:13.951638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:14.024544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c71563-3d53-4338-a065-1e918f4418d5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:14.056539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e882377-ca9c-4739-a643-1d482c6ff553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:14.057166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e882377-ca9c-4739-a643-1d482c6ff553 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:14.057444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e882377-ca9c-4739-a643-1d482c6ff553 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:14.057746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e882377-ca9c-4739-a643-1d482c6ff553 None admin] PATH_INFO: `/v3/domains/25e6b4008cd04f6ab0dcc27f2b431eaf` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:14.070493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e882377-ca9c-4739-a643-1d482c6ff553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=25e6b4008cd04f6ab0dcc27f2b431eaf)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:14.073114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e882377-ca9c-4739-a643-1d482c6ff553 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:14.074715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 587/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Wed Aug 31 19:10:13 2022] GET /identity/v3/domains/25e6b4008cd04f6ab0dcc27f2b431eaf => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:14.081198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a239e-9195-483c-8253-440f48a4f805 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:14.118741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:14.176102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a239e-9195-483c-8253-440f48a4f805 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:14.211135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d759-9a71-485c-9a97-6d36ea3e51e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:14.211743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d759-9a71-485c-9a97-6d36ea3e51e4 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:14.212024 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d759-9a71-485c-9a97-6d36ea3e51e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:14.212306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d759-9a71-485c-9a97-6d36ea3e51e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:14.212960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d759-9a71-485c-9a97-6d36ea3e51e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:14.214422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d759-9a71-485c-9a97-6d36ea3e51e4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:14.300258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 586/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:10:14 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:10:16.240154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043e5fd-aca8-4537-9384-24dc97aea928 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:16.240674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043e5fd-aca8-4537-9384-24dc97aea928 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:16.240788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043e5fd-aca8-4537-9384-24dc97aea928 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:16.242137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 588/1174] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:16.247383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf107-4c71-4512-a76d-7ef36e6787b6 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:16.247767 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf107-4c71-4512-a76d-7ef36e6787b6 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:16.247936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf107-4c71-4512-a76d-7ef36e6787b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:16.266132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-903cf107-4c71-4512-a76d-7ef36e6787b6 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:16.267981 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-903cf107-4c71-4512-a76d-7ef36e6787b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:16.334221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 587/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:10:16.604596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043e5fd-aca8-4537-9384-24dc97aea928 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:16.693340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:16.709253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043e5fd-aca8-4537-9384-24dc97aea928 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:16.743560 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1504405-a9e7-42ed-99cb-ddee5545dea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:16.744196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1504405-a9e7-42ed-99cb-ddee5545dea6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:16.744472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1504405-a9e7-42ed-99cb-ddee5545dea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:16.744744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1504405-a9e7-42ed-99cb-ddee5545dea6 None admin] PATH_INFO: `/v3/domains/25e6b4008cd04f6ab0dcc27f2b431eaf` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:16.745948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1504405-a9e7-42ed-99cb-ddee5545dea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=25e6b4008cd04f6ab0dcc27f2b431eaf)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:16.747380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1504405-a9e7-42ed-99cb-ddee5545dea6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:16.749251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 589/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Wed Aug 31 19:10:16 2022] GET /identity/v3/domains/25e6b4008cd04f6ab0dcc27f2b431eaf => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:16.755444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf107-4c71-4512-a76d-7ef36e6787b6 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:16.776239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:16.852343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf107-4c71-4512-a76d-7ef36e6787b6 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:16.885738 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daaa619-97ff-4036-a878-31cb988f5121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:16.886255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaa619-97ff-4036-a878-31cb988f5121 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:16.886531 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaa619-97ff-4036-a878-31cb988f5121 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:16.887064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaa619-97ff-4036-a878-31cb988f5121 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:16.887495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daaa619-97ff-4036-a878-31cb988f5121 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:16.888955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daaa619-97ff-4036-a878-31cb988f5121 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:16.978727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 588/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:10:16 2022] POST /identity/v3/users => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:10:18.939527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b0646-aa20-427f-93e0-7199bb03255d None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:18.940046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b0646-aa20-427f-93e0-7199bb03255d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:18.940163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b0646-aa20-427f-93e0-7199bb03255d None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:18.941422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 590/1178] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:18.946993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501bc1a-0aa9-4be9-97e1-e09fd59a95fa None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:18.947450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501bc1a-0aa9-4be9-97e1-e09fd59a95fa None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:18.947664 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501bc1a-0aa9-4be9-97e1-e09fd59a95fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:18.965972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-3501bc1a-0aa9-4be9-97e1-e09fd59a95fa None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:18.967161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3501bc1a-0aa9-4be9-97e1-e09fd59a95fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:19.033124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 589/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:10:19.298116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b0646-aa20-427f-93e0-7199bb03255d None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:19.398423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b0646-aa20-427f-93e0-7199bb03255d None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:19.430377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f17a5-b819-4e80-8cc2-61db85dc18e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:19.430992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f17a5-b819-4e80-8cc2-61db85dc18e4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:19.431272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f17a5-b819-4e80-8cc2-61db85dc18e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:19.431548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f17a5-b819-4e80-8cc2-61db85dc18e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:19.441851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f17a5-b819-4e80-8cc2-61db85dc18e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-9f3f17a5-b819-4e80-8cc2-61db85dc18e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:10:19.446812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:10:19.447894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:10:19.448770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 591/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:10:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:10:19.453979 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501bc1a-0aa9-4be9-97e1-e09fd59a95fa None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:19.462536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:19.550568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501bc1a-0aa9-4be9-97e1-e09fd59a95fa None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:19.583843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7803c22-bf54-4f30-802f-90fb2d744c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:19.584444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7803c22-bf54-4f30-802f-90fb2d744c66 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:19.584725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7803c22-bf54-4f30-802f-90fb2d744c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:19.585000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7803c22-bf54-4f30-802f-90fb2d744c66 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:19.585674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7803c22-bf54-4f30-802f-90fb2d744c66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:10:19.585998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7803c22-bf54-4f30-802f-90fb2d744c66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:19.587355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7803c22-bf54-4f30-802f-90fb2d744c66 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:19.595127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 590/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:10:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:19.600972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f17a5-b819-4e80-8cc2-61db85dc18e4 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:19.617499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:19.699211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f17a5-b819-4e80-8cc2-61db85dc18e4 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:19.731388 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b07f5-d023-40ff-95f6-9b9b3a120c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:19.732001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b07f5-d023-40ff-95f6-9b9b3a120c0a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:19.732281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b07f5-d023-40ff-95f6-9b9b3a120c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:19.732553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b07f5-d023-40ff-95f6-9b9b3a120c0a None admin] PATH_INFO: `/v3/users/8faa785ac6ad47bbbfae5789bce43e10` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:19.745723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b07f5-d023-40ff-95f6-9b9b3a120c0a None admin] RBAC: Authorizing `identity:get_user(user_id=8faa785ac6ad47bbbfae5789bce43e10)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:19.747166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b07f5-d023-40ff-95f6-9b9b3a120c0a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:19.748771 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 592/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:10:19 2022] GET /identity/v3/users/8faa785ac6ad47bbbfae5789bce43e10 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:19.755387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7803c22-bf54-4f30-802f-90fb2d744c66 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:19.820402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:19.853028 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7803c22-bf54-4f30-802f-90fb2d744c66 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:19.887663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111ad19-abd1-4453-91a9-6002f2ca46d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:19.888263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111ad19-abd1-4453-91a9-6002f2ca46d1 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:19.888540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111ad19-abd1-4453-91a9-6002f2ca46d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:19.888809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111ad19-abd1-4453-91a9-6002f2ca46d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:19.953211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111ad19-abd1-4453-91a9-6002f2ca46d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:19.954706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111ad19-abd1-4453-91a9-6002f2ca46d1 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:20.015675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:20.049148 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 591/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:10:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:20.055085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b07f5-d023-40ff-95f6-9b9b3a120c0a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:20.124586 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:20.153281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b07f5-d023-40ff-95f6-9b9b3a120c0a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:20.186160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a42fa5-5ab8-4f12-895d-dd05f791638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:20.186786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a42fa5-5ab8-4f12-895d-dd05f791638a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:20.187069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a42fa5-5ab8-4f12-895d-dd05f791638a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:20.187345 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a42fa5-5ab8-4f12-895d-dd05f791638a None admin] PATH_INFO: `/v3/projects/222b887c708740318fd40bc3750c5a15` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:20.188957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a42fa5-5ab8-4f12-895d-dd05f791638a None admin] RBAC: Authorizing `identity:get_project(project_id=222b887c708740318fd40bc3750c5a15)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:20.190418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a42fa5-5ab8-4f12-895d-dd05f791638a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:20.192077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 593/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:10:20 2022] GET /identity/v3/projects/222b887c708740318fd40bc3750c5a15 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:20.198572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111ad19-abd1-4453-91a9-6002f2ca46d1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:20.297491 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111ad19-abd1-4453-91a9-6002f2ca46d1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:20.332632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1307a5d-91e7-4779-b8ce-ed2877b26730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:20.333235 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1307a5d-91e7-4779-b8ce-ed2877b26730 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:20.333513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1307a5d-91e7-4779-b8ce-ed2877b26730 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:20.333817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1307a5d-91e7-4779-b8ce-ed2877b26730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:20.334541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1307a5d-91e7-4779-b8ce-ed2877b26730 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=222b887c708740318fd40bc3750c5a15, user.id=8faa785ac6ad47bbbfae5789bce43e10) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:10:20.334856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1307a5d-91e7-4779-b8ce-ed2877b26730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:20.336276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1307a5d-91e7-4779-b8ce-ed2877b26730 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:20.341555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 592/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:10:20 2022] GET /identity/v3/role_assignments?user.id=8faa785ac6ad47bbbfae5789bce43e10&scope.project.id=222b887c708740318fd40bc3750c5a15&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:22.216301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcde48c-7b06-4fae-a8e3-a4db13b0af62 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:22.216819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcde48c-7b06-4fae-a8e3-a4db13b0af62 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:22.216929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcde48c-7b06-4fae-a8e3-a4db13b0af62 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:22.218266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 594/1186] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:22.223418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588241f2-d93e-4e2a-a7d0-1c6b156a9132 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:22.223848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588241f2-d93e-4e2a-a7d0-1c6b156a9132 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:22.223950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588241f2-d93e-4e2a-a7d0-1c6b156a9132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:22.241609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-588241f2-d93e-4e2a-a7d0-1c6b156a9132 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:22.242810 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-588241f2-d93e-4e2a-a7d0-1c6b156a9132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:22.268364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:22.307546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 593/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:10:22.572472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcde48c-7b06-4fae-a8e3-a4db13b0af62 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:22.675318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcde48c-7b06-4fae-a8e3-a4db13b0af62 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:22.710815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a93929-33af-4efe-9d18-c68e25b89575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:22.711453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a93929-33af-4efe-9d18-c68e25b89575 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:22.711732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a93929-33af-4efe-9d18-c68e25b89575 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:22.712004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a93929-33af-4efe-9d18-c68e25b89575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:22.720394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:22.723595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a93929-33af-4efe-9d18-c68e25b89575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-94a93929-33af-4efe-9d18-c68e25b89575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:10:22.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:10:22.729659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:10:22.744358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 595/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:10:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:10:22.745185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588241f2-d93e-4e2a-a7d0-1c6b156a9132 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:22.844055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588241f2-d93e-4e2a-a7d0-1c6b156a9132 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:22.879975 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d25183-6674-4f55-8709-f54fcd90d476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:22.880601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25183-6674-4f55-8709-f54fcd90d476 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:22.880883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25183-6674-4f55-8709-f54fcd90d476 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:22.881160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25183-6674-4f55-8709-f54fcd90d476 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:22.882033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d25183-6674-4f55-8709-f54fcd90d476 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:10:22.882343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d25183-6674-4f55-8709-f54fcd90d476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:22.883750 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d25183-6674-4f55-8709-f54fcd90d476 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:22.893470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 594/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:10:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:22.899502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a93929-33af-4efe-9d18-c68e25b89575 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:23.003564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a93929-33af-4efe-9d18-c68e25b89575 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:23.038001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddd297-8a0e-4e7e-a3c5-870987560088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:23.038627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddd297-8a0e-4e7e-a3c5-870987560088 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:23.038904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddd297-8a0e-4e7e-a3c5-870987560088 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:23.039174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddd297-8a0e-4e7e-a3c5-870987560088 None admin] PATH_INFO: `/v3/users/8faa785ac6ad47bbbfae5789bce43e10` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:23.040290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddd297-8a0e-4e7e-a3c5-870987560088 None admin] RBAC: Authorizing `identity:get_user(user_id=8faa785ac6ad47bbbfae5789bce43e10)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:23.041717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddd297-8a0e-4e7e-a3c5-870987560088 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:23.043282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 596/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:10:22 2022] GET /identity/v3/users/8faa785ac6ad47bbbfae5789bce43e10 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:23.049428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d25183-6674-4f55-8709-f54fcd90d476 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:23.075365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:23.148880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d25183-6674-4f55-8709-f54fcd90d476 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:23.181592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c2f3f-dd54-467e-a11d-05db49550508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:23.182370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c2f3f-dd54-467e-a11d-05db49550508 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:23.182655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c2f3f-dd54-467e-a11d-05db49550508 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:23.182936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c2f3f-dd54-467e-a11d-05db49550508 None admin] PATH_INFO: `/v3/projects/222b887c708740318fd40bc3750c5a15` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:23.184056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c2f3f-dd54-467e-a11d-05db49550508 None admin] RBAC: Authorizing `identity:get_project(project_id=222b887c708740318fd40bc3750c5a15)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:23.185479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c2f3f-dd54-467e-a11d-05db49550508 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:23.187159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 595/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:10:23 2022] GET /identity/v3/projects/222b887c708740318fd40bc3750c5a15 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:23.193632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddd297-8a0e-4e7e-a3c5-870987560088 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:23.257381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:23.288739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddd297-8a0e-4e7e-a3c5-870987560088 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:23.322532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5da8cd-0d3d-4c30-b36d-af4bde42899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:23.323166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da8cd-0d3d-4c30-b36d-af4bde42899f None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:23.323442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da8cd-0d3d-4c30-b36d-af4bde42899f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:23.323709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da8cd-0d3d-4c30-b36d-af4bde42899f None admin] PATH_INFO: `/v3/projects/222b887c708740318fd40bc3750c5a15/users/8faa785ac6ad47bbbfae5789bce43e10/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:23.325575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5da8cd-0d3d-4c30-b36d-af4bde42899f None admin] RBAC: Authorizing `identity:create_grant(project_id=222b887c708740318fd40bc3750c5a15, user_id=8faa785ac6ad47bbbfae5789bce43e10, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:23.327000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5da8cd-0d3d-4c30-b36d-af4bde42899f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:23.406070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 597/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:10:23 2022] PUT /identity/v3/projects/222b887c708740318fd40bc3750c5a15/users/8faa785ac6ad47bbbfae5789bce43e10/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:10:25.278136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389899cd-26d0-420e-89e6-0656b366473b None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:25.278668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389899cd-26d0-420e-89e6-0656b366473b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:25.278668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389899cd-26d0-420e-89e6-0656b366473b None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:25.280040 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 596/1193] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:25.285838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538902d-d9ca-42b9-b41b-1bdf5983aeca None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:25.286251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538902d-d9ca-42b9-b41b-1bdf5983aeca None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:25.286390 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538902d-d9ca-42b9-b41b-1bdf5983aeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:25.304972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-f538902d-d9ca-42b9-b41b-1bdf5983aeca None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:25.306279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f538902d-d9ca-42b9-b41b-1bdf5983aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:25.373578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 598/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:10:25.646229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389899cd-26d0-420e-89e6-0656b366473b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:25.734843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:25.743961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389899cd-26d0-420e-89e6-0656b366473b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:25.777119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905bfc1-4d8b-4f47-a50f-833c2362663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:25.777761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905bfc1-4d8b-4f47-a50f-833c2362663c None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:25.778038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905bfc1-4d8b-4f47-a50f-833c2362663c None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:25.778309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905bfc1-4d8b-4f47-a50f-833c2362663c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:25.788712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905bfc1-4d8b-4f47-a50f-833c2362663c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-0905bfc1-4d8b-4f47-a50f-833c2362663c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:10:25.793406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:10:25.794497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:10:25.795382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 597/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:10:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:10:25.801154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538902d-d9ca-42b9-b41b-1bdf5983aeca None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:25.858317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:25.899205 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538902d-d9ca-42b9-b41b-1bdf5983aeca None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:25.932293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5acb0-2b98-4fdb-89a8-1b6276a75731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:25.932890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5acb0-2b98-4fdb-89a8-1b6276a75731 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:25.933170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5acb0-2b98-4fdb-89a8-1b6276a75731 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:25.933442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5acb0-2b98-4fdb-89a8-1b6276a75731 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:25.934128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5acb0-2b98-4fdb-89a8-1b6276a75731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:10:25.934430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5acb0-2b98-4fdb-89a8-1b6276a75731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:25.935779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5acb0-2b98-4fdb-89a8-1b6276a75731 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:25.943502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 599/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:25.949656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905bfc1-4d8b-4f47-a50f-833c2362663c None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:26.048882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905bfc1-4d8b-4f47-a50f-833c2362663c None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:26.081679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f864b92-a1f1-46be-add0-d7c18636a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:26.082317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f864b92-a1f1-46be-add0-d7c18636a681 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:26.082593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f864b92-a1f1-46be-add0-d7c18636a681 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:26.082869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f864b92-a1f1-46be-add0-d7c18636a681 None admin] PATH_INFO: `/v3/users/8faa785ac6ad47bbbfae5789bce43e10` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:26.083990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f864b92-a1f1-46be-add0-d7c18636a681 None admin] RBAC: Authorizing `identity:get_user(user_id=8faa785ac6ad47bbbfae5789bce43e10)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:26.085458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f864b92-a1f1-46be-add0-d7c18636a681 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:26.087064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 598/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 31 19:10:25 2022] GET /identity/v3/users/8faa785ac6ad47bbbfae5789bce43e10 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:26.092943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5acb0-2b98-4fdb-89a8-1b6276a75731 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:26.191147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5acb0-2b98-4fdb-89a8-1b6276a75731 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:26.210109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:26.224028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0af96c-f71a-4e96-9c5d-1d58ccbcec3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:26.224626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0af96c-f71a-4e96-9c5d-1d58ccbcec3a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:26.224908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0af96c-f71a-4e96-9c5d-1d58ccbcec3a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:26.225181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0af96c-f71a-4e96-9c5d-1d58ccbcec3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:26.290573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0af96c-f71a-4e96-9c5d-1d58ccbcec3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:26.291591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0af96c-f71a-4e96-9c5d-1d58ccbcec3a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:26.385360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 600/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:10:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:26.391340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f864b92-a1f1-46be-add0-d7c18636a681 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:26.414950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:26.491691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f864b92-a1f1-46be-add0-d7c18636a681 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:26.525637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8e4ea-08dd-4e8e-bc89-deb292892f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:26.526296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8e4ea-08dd-4e8e-bc89-deb292892f54 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:26.526575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8e4ea-08dd-4e8e-bc89-deb292892f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:26.526848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8e4ea-08dd-4e8e-bc89-deb292892f54 None admin] PATH_INFO: `/v3/projects/222b887c708740318fd40bc3750c5a15` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:26.527971 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8e4ea-08dd-4e8e-bc89-deb292892f54 None admin] RBAC: Authorizing `identity:get_project(project_id=222b887c708740318fd40bc3750c5a15)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:26.529406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8e4ea-08dd-4e8e-bc89-deb292892f54 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:26.531080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 599/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 31 19:10:26 2022] GET /identity/v3/projects/222b887c708740318fd40bc3750c5a15 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:26.538438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0af96c-f71a-4e96-9c5d-1d58ccbcec3a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:26.561847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:26.640875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0af96c-f71a-4e96-9c5d-1d58ccbcec3a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:26.677720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf46ed-9791-4d85-b5e2-022f4e7fdb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:26.678327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf46ed-9791-4d85-b5e2-022f4e7fdb84 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:26.678606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf46ed-9791-4d85-b5e2-022f4e7fdb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:26.678945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf46ed-9791-4d85-b5e2-022f4e7fdb84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:26.679663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf46ed-9791-4d85-b5e2-022f4e7fdb84 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=222b887c708740318fd40bc3750c5a15, user.id=8faa785ac6ad47bbbfae5789bce43e10) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:10:26.679969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf46ed-9791-4d85-b5e2-022f4e7fdb84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:26.681377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf46ed-9791-4d85-b5e2-022f4e7fdb84 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:26.687270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 601/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:10:26 2022] GET /identity/v3/role_assignments?user.id=8faa785ac6ad47bbbfae5789bce43e10&scope.project.id=222b887c708740318fd40bc3750c5a15&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:10:36.521409 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=56 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:36.684569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=58 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:42.766430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff3b0-b456-43e7-80ec-36d1090fc6df None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:42.767018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff3b0-b456-43e7-80ec-36d1090fc6df None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:42.767018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ff3b0-b456-43e7-80ec-36d1090fc6df None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:42.768422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 600/1201] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:42.773547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff1f9-0dbf-4ac0-bbe3-8fcdd96fe826 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:42.774024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff1f9-0dbf-4ac0-bbe3-8fcdd96fe826 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:42.774207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff1f9-0dbf-4ac0-bbe3-8fcdd96fe826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:42.792811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-d88ff1f9-0dbf-4ac0-bbe3-8fcdd96fe826 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:42.794010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d88ff1f9-0dbf-4ac0-bbe3-8fcdd96fe826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:42.860706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 602/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:43.133455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ff3b0-b456-43e7-80ec-36d1090fc6df None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:43.241876 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ff3b0-b456-43e7-80ec-36d1090fc6df None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:43.276070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201f6ee-2835-4de5-a5b7-cfc773a10c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:43.279264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201f6ee-2835-4de5-a5b7-cfc773a10c2d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:43.279264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201f6ee-2835-4de5-a5b7-cfc773a10c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:43.279264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201f6ee-2835-4de5-a5b7-cfc773a10c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:43.288593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201f6ee-2835-4de5-a5b7-cfc773a10c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:43.290081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201f6ee-2835-4de5-a5b7-cfc773a10c2d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-1201f6ee-2835-4de5-a5b7-cfc773a10c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:43.305007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:43.306174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:43.307245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:43.307245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:43.307245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:11:43.307245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 601/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:43.313865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff1f9-0dbf-4ac0-bbe3-8fcdd96fe826 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:43.412497 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff1f9-0dbf-4ac0-bbe3-8fcdd96fe826 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:43.440680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:43.446534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89418-39c7-4c23-80a2-4e631001d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:43.447401 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89418-39c7-4c23-80a2-4e631001d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:43.447684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89418-39c7-4c23-80a2-4e631001d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:43.447961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89418-39c7-4c23-80a2-4e631001d2d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:43.448608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89418-39c7-4c23-80a2-4e631001d2d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:43.448915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89418-39c7-4c23-80a2-4e631001d2d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:43.450474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89418-39c7-4c23-80a2-4e631001d2d1 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:43.462312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 603/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:43.468350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201f6ee-2835-4de5-a5b7-cfc773a10c2d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:43.527832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:43.576857 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201f6ee-2835-4de5-a5b7-cfc773a10c2d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:43.611836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f09057-712b-4e3f-970e-171e0e1c03e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:43.612441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f09057-712b-4e3f-970e-171e0e1c03e6 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:43.612724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f09057-712b-4e3f-970e-171e0e1c03e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:43.612996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f09057-712b-4e3f-970e-171e0e1c03e6 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:43.613660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f09057-712b-4e3f-970e-171e0e1c03e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:43.615111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f09057-712b-4e3f-970e-171e0e1c03e6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:43.761129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 602/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 31 19:11:43 2022] POST /identity/v3/users => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:11:45.775646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf63e32-0d1d-4cab-9312-3aa20905c061 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:45.776221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf63e32-0d1d-4cab-9312-3aa20905c061 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:45.776221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf63e32-0d1d-4cab-9312-3aa20905c061 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:45.777533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 604/1206] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:45.782787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f8036-bc7b-4fea-b09a-c8d3dd1687f3 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:45.783224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f8036-bc7b-4fea-b09a-c8d3dd1687f3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:45.783323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f8036-bc7b-4fea-b09a-c8d3dd1687f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:45.801871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-f57f8036-bc7b-4fea-b09a-c8d3dd1687f3 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:45.807472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f57f8036-bc7b-4fea-b09a-c8d3dd1687f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:45.871245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 603/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:46.139325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf63e32-0d1d-4cab-9312-3aa20905c061 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:46.244160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf63e32-0d1d-4cab-9312-3aa20905c061 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:46.278168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7b788-f351-4f47-9ac6-72a8aefb7859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:46.278793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7b788-f351-4f47-9ac6-72a8aefb7859 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:46.279074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7b788-f351-4f47-9ac6-72a8aefb7859 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:46.279346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7b788-f351-4f47-9ac6-72a8aefb7859 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:46.290435 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7b788-f351-4f47-9ac6-72a8aefb7859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-84f7b788-f351-4f47-9ac6-72a8aefb7859 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:11:46.295321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:46.297023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:46.299181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:11:46.302072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 605/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:11:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:46.303089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f8036-bc7b-4fea-b09a-c8d3dd1687f3 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:46.342422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:46.399820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f8036-bc7b-4fea-b09a-c8d3dd1687f3 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:46.433868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69e8b1-2eb5-4532-a312-faa126703d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:46.434476 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69e8b1-2eb5-4532-a312-faa126703d16 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:46.434758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69e8b1-2eb5-4532-a312-faa126703d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:46.435031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69e8b1-2eb5-4532-a312-faa126703d16 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:46.435702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69e8b1-2eb5-4532-a312-faa126703d16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:46.436007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69e8b1-2eb5-4532-a312-faa126703d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:46.437407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69e8b1-2eb5-4532-a312-faa126703d16 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:46.446056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 604/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:11:46.452044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7b788-f351-4f47-9ac6-72a8aefb7859 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:46.502693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:46.555236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7b788-f351-4f47-9ac6-72a8aefb7859 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:46.587238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f79353-2763-44ee-9d01-242abb13ef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:46.587852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f79353-2763-44ee-9d01-242abb13ef5a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:46.588152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f79353-2763-44ee-9d01-242abb13ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:46.588425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f79353-2763-44ee-9d01-242abb13ef5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:46.599437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f79353-2763-44ee-9d01-242abb13ef5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:46.600762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f79353-2763-44ee-9d01-242abb13ef5a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-b4f79353-2763-44ee-9d01-242abb13ef5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:46.615737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:46.616893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:46.617963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:46.617963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:46.617963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:11:46.617963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 606/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:46.622939 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69e8b1-2eb5-4532-a312-faa126703d16 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:46.721336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:46.724390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69e8b1-2eb5-4532-a312-faa126703d16 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:46.757992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c75f9-e816-464f-aa7d-da66b7890c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:46.758572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c75f9-e816-464f-aa7d-da66b7890c9d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:46.758851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c75f9-e816-464f-aa7d-da66b7890c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:46.759127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c75f9-e816-464f-aa7d-da66b7890c9d None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:46.759784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c75f9-e816-464f-aa7d-da66b7890c9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:46.760085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c75f9-e816-464f-aa7d-da66b7890c9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:46.761445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c75f9-e816-464f-aa7d-da66b7890c9d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:46.773206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 605/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:46.778934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f79353-2763-44ee-9d01-242abb13ef5a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:46.912829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f79353-2763-44ee-9d01-242abb13ef5a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:46.914475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:46.946047 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6993a-8cb4-44db-8967-1abe63123a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:46.946682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6993a-8cb4-44db-8967-1abe63123a79 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:46.947212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6993a-8cb4-44db-8967-1abe63123a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:46.947494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6993a-8cb4-44db-8967-1abe63123a79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:46.955935 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6993a-8cb4-44db-8967-1abe63123a79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:46.957455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6993a-8cb4-44db-8967-1abe63123a79 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-cfc6993a-8cb4-44db-8967-1abe63123a79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:11:46.968979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:46.970704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:11:46.971765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 607/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:46.976821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c75f9-e816-464f-aa7d-da66b7890c9d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:47.081961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c75f9-e816-464f-aa7d-da66b7890c9d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:47.123320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4320e6-7114-4c08-9a81-25888eecc5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:47.123954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4320e6-7114-4c08-9a81-25888eecc5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:47.124231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4320e6-7114-4c08-9a81-25888eecc5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:47.124504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4320e6-7114-4c08-9a81-25888eecc5a4 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:47.125236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4320e6-7114-4c08-9a81-25888eecc5a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:47.125538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4320e6-7114-4c08-9a81-25888eecc5a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:47.127076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4320e6-7114-4c08-9a81-25888eecc5a4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:47.146659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 606/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 31 19:11:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:47.152974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6993a-8cb4-44db-8967-1abe63123a79 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:47.259081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6993a-8cb4-44db-8967-1abe63123a79 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:47.294384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb21af0-be22-4060-b451-ea3d7479a83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:47.294992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb21af0-be22-4060-b451-ea3d7479a83a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:47.295270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb21af0-be22-4060-b451-ea3d7479a83a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:47.295537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb21af0-be22-4060-b451-ea3d7479a83a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:47.328359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:47.371713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb21af0-be22-4060-b451-ea3d7479a83a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:47.373168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb21af0-be22-4060-b451-ea3d7479a83a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:47.484378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 608/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:11:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:11:47.490454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4320e6-7114-4c08-9a81-25888eecc5a4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:47.511633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:47.597379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4320e6-7114-4c08-9a81-25888eecc5a4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:47.641275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5023af9-e2fc-47b6-8eb8-bbc1aab2bbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:47.641940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5023af9-e2fc-47b6-8eb8-bbc1aab2bbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:47.642220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5023af9-e2fc-47b6-8eb8-bbc1aab2bbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:47.642495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5023af9-e2fc-47b6-8eb8-bbc1aab2bbc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:47.653464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5023af9-e2fc-47b6-8eb8-bbc1aab2bbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:47.654945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5023af9-e2fc-47b6-8eb8-bbc1aab2bbc5 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-a5023af9-e2fc-47b6-8eb8-bbc1aab2bbc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:47.670914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:47.672748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:47.675020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:47.675020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:47.675020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:11:47.675020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 607/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:47.678926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb21af0-be22-4060-b451-ea3d7479a83a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:47.744985 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:47.784946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb21af0-be22-4060-b451-ea3d7479a83a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:47.820863 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45ca2a-1dd7-4c61-81ac-6954663500be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:47.821501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ca2a-1dd7-4c61-81ac-6954663500be None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:47.821824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ca2a-1dd7-4c61-81ac-6954663500be None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:47.822388 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ca2a-1dd7-4c61-81ac-6954663500be None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:47.823440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45ca2a-1dd7-4c61-81ac-6954663500be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:47.823440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45ca2a-1dd7-4c61-81ac-6954663500be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:47.824660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45ca2a-1dd7-4c61-81ac-6954663500be None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:47.836932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 609/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:47.842775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5023af9-e2fc-47b6-8eb8-bbc1aab2bbc5 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:47.912700 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:47.943737 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5023af9-e2fc-47b6-8eb8-bbc1aab2bbc5 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:47.978044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50925d5e-09fb-4a1d-a9ae-51488865cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:47.978720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50925d5e-09fb-4a1d-a9ae-51488865cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:47.978932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50925d5e-09fb-4a1d-a9ae-51488865cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:47.979201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50925d5e-09fb-4a1d-a9ae-51488865cbc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:47.986277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50925d5e-09fb-4a1d-a9ae-51488865cbc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:47.987695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50925d5e-09fb-4a1d-a9ae-51488865cbc9 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-50925d5e-09fb-4a1d-a9ae-51488865cbc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:11:47.999374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:48.000461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:48.002167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:11:48.002167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:11:48.002167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:11:48.002167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:11:48.002167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:11:48.002167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:11:48.002167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:48.002167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:11:48.005822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 608/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:48.007025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45ca2a-1dd7-4c61-81ac-6954663500be None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:48.106098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45ca2a-1dd7-4c61-81ac-6954663500be None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:48.128251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:48.139315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b1707-c476-4b22-b0e1-a8257e6d4979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:48.139913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b1707-c476-4b22-b0e1-a8257e6d4979 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:48.140189 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b1707-c476-4b22-b0e1-a8257e6d4979 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:48.140458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b1707-c476-4b22-b0e1-a8257e6d4979 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:48.141137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b1707-c476-4b22-b0e1-a8257e6d4979 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:48.141440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b1707-c476-4b22-b0e1-a8257e6d4979 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:48.142874 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b1707-c476-4b22-b0e1-a8257e6d4979 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:48.154240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 610/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:11:48.161386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50925d5e-09fb-4a1d-a9ae-51488865cbc9 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:48.260811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50925d5e-09fb-4a1d-a9ae-51488865cbc9 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:48.289068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:48.294778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51491307-bb57-4495-90a5-2927569c0140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:48.295380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51491307-bb57-4495-90a5-2927569c0140 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:48.295657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51491307-bb57-4495-90a5-2927569c0140 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:48.295933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51491307-bb57-4495-90a5-2927569c0140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:48.296663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51491307-bb57-4495-90a5-2927569c0140 None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=b98cb3da3efe49acbfe640366bf7b53b) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:48.296967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51491307-bb57-4495-90a5-2927569c0140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:48.299033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51491307-bb57-4495-90a5-2927569c0140 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:48.304375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 609/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:11:48 2022] GET /identity/v3/role_assignments?user.id=b98cb3da3efe49acbfe640366bf7b53b&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:50.200247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b917-ae2f-4ffd-99e5-bf20da0e3eba None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:50.200788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b917-ae2f-4ffd-99e5-bf20da0e3eba None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:50.200788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b917-ae2f-4ffd-99e5-bf20da0e3eba None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:50.202230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 611/1220] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:50.208558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d5bb-08ee-4b02-bf26-6645ec63021c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:50.211537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d5bb-08ee-4b02-bf26-6645ec63021c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:50.211537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d5bb-08ee-4b02-bf26-6645ec63021c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:50.228463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5708d5bb-08ee-4b02-bf26-6645ec63021c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:50.229701 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5708d5bb-08ee-4b02-bf26-6645ec63021c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:50.303713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 610/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:50.578504 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1b917-ae2f-4ffd-99e5-bf20da0e3eba None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:50.698743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1b917-ae2f-4ffd-99e5-bf20da0e3eba None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:50.733264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b0672-368d-41c2-b898-105b10abf86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:50.733936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b0672-368d-41c2-b898-105b10abf86f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:50.734219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b0672-368d-41c2-b898-105b10abf86f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:50.734492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b0672-368d-41c2-b898-105b10abf86f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:50.746324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b0672-368d-41c2-b898-105b10abf86f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-f26b0672-368d-41c2-b898-105b10abf86f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:11:50.751194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:50.752861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:11:50.753970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 612/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:11:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:50.758908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708d5bb-08ee-4b02-bf26-6645ec63021c None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:50.864373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708d5bb-08ee-4b02-bf26-6645ec63021c None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:50.889745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:50.902036 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b45e14-e310-4e82-87fc-79953603b046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:50.902755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b45e14-e310-4e82-87fc-79953603b046 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:50.903080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b45e14-e310-4e82-87fc-79953603b046 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:50.903397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b45e14-e310-4e82-87fc-79953603b046 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:50.904114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b45e14-e310-4e82-87fc-79953603b046 None admin] RBAC: Adding query filter params (name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:50.904600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b45e14-e310-4e82-87fc-79953603b046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:50.906056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b45e14-e310-4e82-87fc-79953603b046 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:50.914748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 611/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:11:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:50.920584 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b0672-368d-41c2-b898-105b10abf86f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:50.968068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:51.026854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b0672-368d-41c2-b898-105b10abf86f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:51.061251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b573be-b44b-49a7-b01b-1b26463397aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:51.061913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b573be-b44b-49a7-b01b-1b26463397aa None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:51.062221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b573be-b44b-49a7-b01b-1b26463397aa None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:51.062500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b573be-b44b-49a7-b01b-1b26463397aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:51.072696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b573be-b44b-49a7-b01b-1b26463397aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:51.075840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b573be-b44b-49a7-b01b-1b26463397aa None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-d1b573be-b44b-49a7-b01b-1b26463397aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:51.088679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:51.089838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:51.090950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:51.090950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:51.090950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:11:51.090950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 613/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:51.096226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b45e14-e310-4e82-87fc-79953603b046 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:51.196565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b45e14-e310-4e82-87fc-79953603b046 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:51.232063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792b0c1-d6db-4640-b529-696aa72fae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:51.232685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b0c1-d6db-4640-b529-696aa72fae43 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:51.232941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b0c1-d6db-4640-b529-696aa72fae43 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:51.233219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b0c1-d6db-4640-b529-696aa72fae43 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:51.233898 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792b0c1-d6db-4640-b529-696aa72fae43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:51.234208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792b0c1-d6db-4640-b529-696aa72fae43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:51.235613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792b0c1-d6db-4640-b529-696aa72fae43 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:51.249159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 612/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:51.255326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b573be-b44b-49a7-b01b-1b26463397aa None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:51.353227 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:51.359989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b573be-b44b-49a7-b01b-1b26463397aa None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:51.393690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78c211-3c2b-46d7-a299-99e94026abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:51.394319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c211-3c2b-46d7-a299-99e94026abba None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:51.394604 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c211-3c2b-46d7-a299-99e94026abba None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:51.394879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c211-3c2b-46d7-a299-99e94026abba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:51.402225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78c211-3c2b-46d7-a299-99e94026abba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:51.403657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78c211-3c2b-46d7-a299-99e94026abba None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-7d78c211-3c2b-46d7-a299-99e94026abba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:11:51.415386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:51.421469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:11:51.422708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 614/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:11:51.423430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792b0c1-d6db-4640-b529-696aa72fae43 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:51.470899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:51.522354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792b0c1-d6db-4640-b529-696aa72fae43 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:51.556475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddffbc-09ee-4b6e-82be-3699b4392c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:51.557079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddffbc-09ee-4b6e-82be-3699b4392c1a None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:51.557365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddffbc-09ee-4b6e-82be-3699b4392c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:51.557634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddffbc-09ee-4b6e-82be-3699b4392c1a None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:51.558407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddffbc-09ee-4b6e-82be-3699b4392c1a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:51.558714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddffbc-09ee-4b6e-82be-3699b4392c1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:51.560133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddffbc-09ee-4b6e-82be-3699b4392c1a None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:51.578762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 613/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 31 19:11:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:51.584976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78c211-3c2b-46d7-a299-99e94026abba None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:51.686583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78c211-3c2b-46d7-a299-99e94026abba None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:51.723384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da5022-3396-4ceb-9cce-5be139fe8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:51.724006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5022-3396-4ceb-9cce-5be139fe8d22 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:51.724291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5022-3396-4ceb-9cce-5be139fe8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:51.724568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5022-3396-4ceb-9cce-5be139fe8d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:51.736035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da5022-3396-4ceb-9cce-5be139fe8d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:51.737487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da5022-3396-4ceb-9cce-5be139fe8d22 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-95da5022-3396-4ceb-9cce-5be139fe8d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:51.752790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:51.754159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:51.755188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:51.755188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:51.755188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:11:51.755188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 615/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:51.760221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddffbc-09ee-4b6e-82be-3699b4392c1a None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:51.865403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddffbc-09ee-4b6e-82be-3699b4392c1a None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:51.867848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:51.899419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd093-b1c8-42d9-b9f5-ff3b216ab293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:51.900044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd093-b1c8-42d9-b9f5-ff3b216ab293 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:51.900323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd093-b1c8-42d9-b9f5-ff3b216ab293 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:51.900596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd093-b1c8-42d9-b9f5-ff3b216ab293 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:51.901306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbd093-b1c8-42d9-b9f5-ff3b216ab293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:51.901610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbd093-b1c8-42d9-b9f5-ff3b216ab293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:51.903053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbd093-b1c8-42d9-b9f5-ff3b216ab293 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:51.913941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 614/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:51.919743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da5022-3396-4ceb-9cce-5be139fe8d22 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:51.929580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:52.020391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da5022-3396-4ceb-9cce-5be139fe8d22 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:52.052178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17504fac-5e64-41d3-bfb3-bf554e65f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:52.052822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17504fac-5e64-41d3-bfb3-bf554e65f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:52.053102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17504fac-5e64-41d3-bfb3-bf554e65f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:52.053376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17504fac-5e64-41d3-bfb3-bf554e65f1b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:52.060460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17504fac-5e64-41d3-bfb3-bf554e65f1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:52.061917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17504fac-5e64-41d3-bfb3-bf554e65f1b8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-17504fac-5e64-41d3-bfb3-bf554e65f1b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:11:52.074448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:52.075529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:52.076983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:11:52.076983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:11:52.076983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:11:52.076983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:11:52.076983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:11:52.076983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:11:52.076983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:52.076983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:11:52.076983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 616/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:52.082141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd093-b1c8-42d9-b9f5-ff3b216ab293 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:52.183277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd093-b1c8-42d9-b9f5-ff3b216ab293 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:52.222157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92863-6f64-4c78-a927-cf35d403d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:52.222769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92863-6f64-4c78-a927-cf35d403d75b None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:52.223050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92863-6f64-4c78-a927-cf35d403d75b None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:52.223329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92863-6f64-4c78-a927-cf35d403d75b None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:52.224029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92863-6f64-4c78-a927-cf35d403d75b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:52.224337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92863-6f64-4c78-a927-cf35d403d75b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:52.225809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd92863-6f64-4c78-a927-cf35d403d75b None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:52.238710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 615/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:52.245168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17504fac-5e64-41d3-bfb3-bf554e65f1b8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:52.310395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:52.345240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17504fac-5e64-41d3-bfb3-bf554e65f1b8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:52.386664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b11121-aa5b-41a1-af8b-01f236fc5864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:52.387327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b11121-aa5b-41a1-af8b-01f236fc5864 None admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:52.387613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b11121-aa5b-41a1-af8b-01f236fc5864 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:52.387892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b11121-aa5b-41a1-af8b-01f236fc5864 None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/b98cb3da3efe49acbfe640366bf7b53b/roles/5d7b9f9df87e4195be39d4c61f682b55` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:52.403839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b11121-aa5b-41a1-af8b-01f236fc5864 None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=b98cb3da3efe49acbfe640366bf7b53b, role_id=5d7b9f9df87e4195be39d4c61f682b55)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:52.405315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b11121-aa5b-41a1-af8b-01f236fc5864 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:52.486154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 617/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:11:52 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/b98cb3da3efe49acbfe640366bf7b53b/roles/5d7b9f9df87e4195be39d4c61f682b55 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:11:54.404524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21786e6-a24f-47aa-b99d-c6b023adfde1 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:54.405055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21786e6-a24f-47aa-b99d-c6b023adfde1 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:54.405055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21786e6-a24f-47aa-b99d-c6b023adfde1 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:54.406458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 616/1233] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:54.412376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa0c93-7b09-41f2-99fd-b51295fe2400 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:54.412803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa0c93-7b09-41f2-99fd-b51295fe2400 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:54.412932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa0c93-7b09-41f2-99fd-b51295fe2400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:54.431332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-0baa0c93-7b09-41f2-99fd-b51295fe2400 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:54.432619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0baa0c93-7b09-41f2-99fd-b51295fe2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:54.498608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 618/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:54.770908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21786e6-a24f-47aa-b99d-c6b023adfde1 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:54.796710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:54.879584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21786e6-a24f-47aa-b99d-c6b023adfde1 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:54.914506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a7e20-819f-454c-ac5e-18313110f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:54.915149 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a7e20-819f-454c-ac5e-18313110f135 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:54.915431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a7e20-819f-454c-ac5e-18313110f135 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:54.915708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a7e20-819f-454c-ac5e-18313110f135 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:54.926488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a7e20-819f-454c-ac5e-18313110f135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-7e3a7e20-819f-454c-ac5e-18313110f135 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:11:54.931478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:54.932516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:11:54.933540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 617/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 31 19:11:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:54.939587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa0c93-7b09-41f2-99fd-b51295fe2400 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:54.987351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:55.048247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa0c93-7b09-41f2-99fd-b51295fe2400 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:55.086270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88825f78-b6ad-4c03-b2c4-ef6043a8d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:55.086853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88825f78-b6ad-4c03-b2c4-ef6043a8d749 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:55.087132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88825f78-b6ad-4c03-b2c4-ef6043a8d749 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:55.087449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88825f78-b6ad-4c03-b2c4-ef6043a8d749 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:55.088116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88825f78-b6ad-4c03-b2c4-ef6043a8d749 None admin] RBAC: Adding query filter params (name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:55.088469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88825f78-b6ad-4c03-b2c4-ef6043a8d749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:55.089867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88825f78-b6ad-4c03-b2c4-ef6043a8d749 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:55.097617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 619/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 31 19:11:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:55.103504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a7e20-819f-454c-ac5e-18313110f135 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:55.195653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:55.211536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a7e20-819f-454c-ac5e-18313110f135 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:55.245173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4920712-f0bc-480c-9cd2-bc4057886499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:55.245865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4920712-f0bc-480c-9cd2-bc4057886499 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:55.246140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4920712-f0bc-480c-9cd2-bc4057886499 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:55.246410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4920712-f0bc-480c-9cd2-bc4057886499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:55.257347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4920712-f0bc-480c-9cd2-bc4057886499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:55.258852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4920712-f0bc-480c-9cd2-bc4057886499 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-b4920712-f0bc-480c-9cd2-bc4057886499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:55.273220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:55.274337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:55.275226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:55.275226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:55.275226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:11:55.275226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 618/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:55.280262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88825f78-b6ad-4c03-b2c4-ef6043a8d749 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:55.391057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88825f78-b6ad-4c03-b2c4-ef6043a8d749 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:55.400001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:55.424451 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d874d16-df95-4183-af6f-8fa869f22044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:55.425114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874d16-df95-4183-af6f-8fa869f22044 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:55.425348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874d16-df95-4183-af6f-8fa869f22044 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:55.425626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d874d16-df95-4183-af6f-8fa869f22044 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:55.426288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d874d16-df95-4183-af6f-8fa869f22044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:55.426596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d874d16-df95-4183-af6f-8fa869f22044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:55.427959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d874d16-df95-4183-af6f-8fa869f22044 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:55.440305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 620/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:55.446171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4920712-f0bc-480c-9cd2-bc4057886499 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:55.551244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4920712-f0bc-480c-9cd2-bc4057886499 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:55.585430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ab07d-78ed-4d25-8f1e-17bbbdda04b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:55.586098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab07d-78ed-4d25-8f1e-17bbbdda04b4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:55.586459 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab07d-78ed-4d25-8f1e-17bbbdda04b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:55.586725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab07d-78ed-4d25-8f1e-17bbbdda04b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:55.589595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:55.595479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ab07d-78ed-4d25-8f1e-17bbbdda04b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:55.596931 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ab07d-78ed-4d25-8f1e-17bbbdda04b4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-367ab07d-78ed-4d25-8f1e-17bbbdda04b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:11:55.608377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:55.609505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:11:55.611301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 619/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:55.616115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d874d16-df95-4183-af6f-8fa869f22044 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:55.717046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d874d16-df95-4183-af6f-8fa869f22044 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:55.750895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3d755-26cc-4fab-ac62-18539feaa277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:55.751539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3d755-26cc-4fab-ac62-18539feaa277 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:55.751862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3d755-26cc-4fab-ac62-18539feaa277 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:55.752140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3d755-26cc-4fab-ac62-18539feaa277 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:55.752891 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3d755-26cc-4fab-ac62-18539feaa277 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:55.753196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3d755-26cc-4fab-ac62-18539feaa277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:55.754658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3d755-26cc-4fab-ac62-18539feaa277 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:55.772668 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 621/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 31 19:11:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:55.778676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ab07d-78ed-4d25-8f1e-17bbbdda04b4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:55.886645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ab07d-78ed-4d25-8f1e-17bbbdda04b4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:55.921675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a2867-7645-4c45-a229-06cb5b5b964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:55.922303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a2867-7645-4c45-a229-06cb5b5b964f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:55.922579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a2867-7645-4c45-a229-06cb5b5b964f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:55.922847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a2867-7645-4c45-a229-06cb5b5b964f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:55.984569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:55.990931 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a2867-7645-4c45-a229-06cb5b5b964f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:55.992386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a2867-7645-4c45-a229-06cb5b5b964f None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:56.091803 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 620/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:11:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:11:56.098484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3d755-26cc-4fab-ac62-18539feaa277 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:56.125728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:56.199606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3d755-26cc-4fab-ac62-18539feaa277 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:56.234263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d1f61-ffa6-456f-a81e-4922b61703ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:56.240974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d1f61-ffa6-456f-a81e-4922b61703ff None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:56.240974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d1f61-ffa6-456f-a81e-4922b61703ff None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:56.240974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d1f61-ffa6-456f-a81e-4922b61703ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:56.245319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d1f61-ffa6-456f-a81e-4922b61703ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:56.246783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d1f61-ffa6-456f-a81e-4922b61703ff None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-c44d1f61-ffa6-456f-a81e-4922b61703ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:56.261732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:56.263001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:56.264090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:56.264090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:56.264090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:11:56.264090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 622/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:56.269769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a2867-7645-4c45-a229-06cb5b5b964f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:56.366640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:56.372415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a2867-7645-4c45-a229-06cb5b5b964f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:56.407265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe312aa-b100-49ff-9997-355dca48a5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:56.407890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe312aa-b100-49ff-9997-355dca48a5bc None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:56.408177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe312aa-b100-49ff-9997-355dca48a5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:56.408450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe312aa-b100-49ff-9997-355dca48a5bc None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:56.409088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe312aa-b100-49ff-9997-355dca48a5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:56.409391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe312aa-b100-49ff-9997-355dca48a5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:56.410820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe312aa-b100-49ff-9997-355dca48a5bc None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:56.422038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 621/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:56.427857 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d1f61-ffa6-456f-a81e-4922b61703ff None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:56.513502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:56.536410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d1f61-ffa6-456f-a81e-4922b61703ff None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:56.570197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62818-46d7-4ad7-8303-589cfd2f9dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:56.570801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62818-46d7-4ad7-8303-589cfd2f9dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:56.571081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62818-46d7-4ad7-8303-589cfd2f9dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:56.571434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62818-46d7-4ad7-8303-589cfd2f9dc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:56.578534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a62818-46d7-4ad7-8303-589cfd2f9dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:56.579989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a62818-46d7-4ad7-8303-589cfd2f9dc8 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-73a62818-46d7-4ad7-8303-589cfd2f9dc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:11:56.592204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:56.595937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:56.596945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:11:56.596945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:11:56.596945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:11:56.596945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:11:56.596945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:11:56.596945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:11:56.596945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:11:56.596945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:11:56.596945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 623/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:11:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:56.599956 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe312aa-b100-49ff-9997-355dca48a5bc None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:56.702257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe312aa-b100-49ff-9997-355dca48a5bc None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:56.736944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a412727-e49c-47ea-b634-53335b8becbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:56.737556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a412727-e49c-47ea-b634-53335b8becbb None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:56.737905 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a412727-e49c-47ea-b634-53335b8becbb None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:56.738145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a412727-e49c-47ea-b634-53335b8becbb None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:56.738844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a412727-e49c-47ea-b634-53335b8becbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:56.739157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a412727-e49c-47ea-b634-53335b8becbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:56.740569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a412727-e49c-47ea-b634-53335b8becbb None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:56.753543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 622/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:56.759784 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62818-46d7-4ad7-8303-589cfd2f9dc8 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:56.863509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62818-46d7-4ad7-8303-589cfd2f9dc8 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:56.897884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a909a6-826b-4974-9dad-4c5210d0e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:56.898618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a909a6-826b-4974-9dad-4c5210d0e551 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:56.898890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a909a6-826b-4974-9dad-4c5210d0e551 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:56.899169 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a909a6-826b-4974-9dad-4c5210d0e551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:56.899898 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a909a6-826b-4974-9dad-4c5210d0e551 None admin] RBAC: Adding query filter params (role.id=5d7b9f9df87e4195be39d4c61f682b55, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=b98cb3da3efe49acbfe640366bf7b53b) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:56.900206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a909a6-826b-4974-9dad-4c5210d0e551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:56.901634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a909a6-826b-4974-9dad-4c5210d0e551 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:56.908296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 624/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:11:56 2022] GET /identity/v3/role_assignments?user.id=b98cb3da3efe49acbfe640366bf7b53b&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=5d7b9f9df87e4195be39d4c61f682b55 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:58.879481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d670b-64a7-4fb2-99db-e5b5defde493 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:58.970170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d670b-64a7-4fb2-99db-e5b5defde493 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:58.970170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d670b-64a7-4fb2-99db-e5b5defde493 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:58.970170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 623/1247] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:58.970501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344448-1cb1-457f-876e-c4b6790b1ba7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:58.970501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344448-1cb1-457f-876e-c4b6790b1ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:58.970501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344448-1cb1-457f-876e-c4b6790b1ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:58.970501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:58.970501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-d5344448-1cb1-457f-876e-c4b6790b1ba7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:58.970501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d5344448-1cb1-457f-876e-c4b6790b1ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:58.979291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 625/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:11:59.245643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d670b-64a7-4fb2-99db-e5b5defde493 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:59.264430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:59.352865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d670b-64a7-4fb2-99db-e5b5defde493 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:59.388704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3744bec-c5ae-40c7-b58c-656049657fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:59.389335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3744bec-c5ae-40c7-b58c-656049657fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:59.389616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3744bec-c5ae-40c7-b58c-656049657fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:59.389923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3744bec-c5ae-40c7-b58c-656049657fe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:59.400288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3744bec-c5ae-40c7-b58c-656049657fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-a3744bec-c5ae-40c7-b58c-656049657fe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:11:59.405121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:59.406327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:11:59.407982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 624/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:59.413144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5344448-1cb1-457f-876e-c4b6790b1ba7 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:59.515708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5344448-1cb1-457f-876e-c4b6790b1ba7 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:59.549197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:59.554092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabdb6e-4bed-414a-9a46-aae19173b5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:59.554702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabdb6e-4bed-414a-9a46-aae19173b5ab None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:59.554980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabdb6e-4bed-414a-9a46-aae19173b5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:59.555251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabdb6e-4bed-414a-9a46-aae19173b5ab None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:59.555919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabdb6e-4bed-414a-9a46-aae19173b5ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:59.556219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabdb6e-4bed-414a-9a46-aae19173b5ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:59.557634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabdb6e-4bed-414a-9a46-aae19173b5ab None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:59.566267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 626/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:59.583811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3744bec-c5ae-40c7-b58c-656049657fe4 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:59.653909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:59.678572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3744bec-c5ae-40c7-b58c-656049657fe4 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:59.717147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b381-a1d5-4931-baf3-1a7aabdc2a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:59.717808 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b381-a1d5-4931-baf3-1a7aabdc2a73 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:59.718083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b381-a1d5-4931-baf3-1a7aabdc2a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:59.718352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b381-a1d5-4931-baf3-1a7aabdc2a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:59.729448 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415b381-a1d5-4931-baf3-1a7aabdc2a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:59.730945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415b381-a1d5-4931-baf3-1a7aabdc2a73 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-f415b381-a1d5-4931-baf3-1a7aabdc2a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:11:59.746482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:11:59.747638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:11:59.748726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:11:59.748726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:11:59.748726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:11:59.748726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 625/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:11:59.753869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabdb6e-4bed-414a-9a46-aae19173b5ab None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:59.854179 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabdb6e-4bed-414a-9a46-aae19173b5ab None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:59.892433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c8c0-a6d8-4431-bbcb-546b4da34adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:59.893081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c8c0-a6d8-4431-bbcb-546b4da34adf None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:59.893360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c8c0-a6d8-4431-bbcb-546b4da34adf None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:59.893629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c8c0-a6d8-4431-bbcb-546b4da34adf None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:59.894339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796c8c0-a6d8-4431-bbcb-546b4da34adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:11:59.894639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796c8c0-a6d8-4431-bbcb-546b4da34adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:59.896000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796c8c0-a6d8-4431-bbcb-546b4da34adf None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:59.908749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 627/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:11:59.914762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b381-a1d5-4931-baf3-1a7aabdc2a73 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:00.025946 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b381-a1d5-4931-baf3-1a7aabdc2a73 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:00.052940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:00.060834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fffc2f-c1ed-465b-928c-7e260c541d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:00.061457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffc2f-c1ed-465b-928c-7e260c541d60 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:00.061757 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffc2f-c1ed-465b-928c-7e260c541d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:00.062068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffc2f-c1ed-465b-928c-7e260c541d60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:00.070508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fffc2f-c1ed-465b-928c-7e260c541d60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:00.071949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fffc2f-c1ed-465b-928c-7e260c541d60 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-c2fffc2f-c1ed-465b-928c-7e260c541d60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:12:00.086765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:00.087982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:12:00.089168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 626/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:11:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:00.091613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c8c0-a6d8-4431-bbcb-546b4da34adf None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:00.148856 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:00.195331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c8c0-a6d8-4431-bbcb-546b4da34adf None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:00.230353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd117f5-d1f2-4fac-92e2-928907657b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:00.230958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd117f5-d1f2-4fac-92e2-928907657b7b None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:00.231239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd117f5-d1f2-4fac-92e2-928907657b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:00.231517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd117f5-d1f2-4fac-92e2-928907657b7b None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:00.232242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd117f5-d1f2-4fac-92e2-928907657b7b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:00.232551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd117f5-d1f2-4fac-92e2-928907657b7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:00.234000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd117f5-d1f2-4fac-92e2-928907657b7b None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:00.252728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 628/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 31 19:12:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:00.258664 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fffc2f-c1ed-465b-928c-7e260c541d60 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:00.374453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fffc2f-c1ed-465b-928c-7e260c541d60 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:00.413051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4a376-d74f-42db-a406-ce14d31582c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:00.413780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4a376-d74f-42db-a406-ce14d31582c6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:00.414067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4a376-d74f-42db-a406-ce14d31582c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:00.414347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4a376-d74f-42db-a406-ce14d31582c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:00.479274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:00.492735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4a376-d74f-42db-a406-ce14d31582c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:00.494305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4a376-d74f-42db-a406-ce14d31582c6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:00.614295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 627/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:12:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:12:00.620566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd117f5-d1f2-4fac-92e2-928907657b7b None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:00.725537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd117f5-d1f2-4fac-92e2-928907657b7b None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:00.739354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:00.760549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c3ee9-2e98-4cc3-b2b6-51fa5ae03407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:00.761179 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c3ee9-2e98-4cc3-b2b6-51fa5ae03407 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:00.761459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c3ee9-2e98-4cc3-b2b6-51fa5ae03407 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:00.761832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c3ee9-2e98-4cc3-b2b6-51fa5ae03407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:00.772378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c3ee9-2e98-4cc3-b2b6-51fa5ae03407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:00.775901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c3ee9-2e98-4cc3-b2b6-51fa5ae03407 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-978c3ee9-2e98-4cc3-b2b6-51fa5ae03407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:12:00.789790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:00.791125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:12:00.792062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:12:00.792062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:12:00.792062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:00.792062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 629/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:00.797089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4a376-d74f-42db-a406-ce14d31582c6 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:00.889850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:00.901547 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4a376-d74f-42db-a406-ce14d31582c6 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:00.936208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c5978-f1c1-4c0b-8c66-1781fe7cb2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:00.936908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c5978-f1c1-4c0b-8c66-1781fe7cb2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:00.937093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c5978-f1c1-4c0b-8c66-1781fe7cb2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:00.937379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c5978-f1c1-4c0b-8c66-1781fe7cb2c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:00.938121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c5978-f1c1-4c0b-8c66-1781fe7cb2c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:00.943159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c5978-f1c1-4c0b-8c66-1781fe7cb2c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:00.943159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c5978-f1c1-4c0b-8c66-1781fe7cb2c9 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:00.951724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 628/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:00.957986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c3ee9-2e98-4cc3-b2b6-51fa5ae03407 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:01.060213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c3ee9-2e98-4cc3-b2b6-51fa5ae03407 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:01.094179 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef9223-74bf-4a76-9cba-d56202c7c964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:01.095369 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef9223-74bf-4a76-9cba-d56202c7c964 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:01.095573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef9223-74bf-4a76-9cba-d56202c7c964 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:01.095848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef9223-74bf-4a76-9cba-d56202c7c964 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:01.102941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef9223-74bf-4a76-9cba-d56202c7c964 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:01.104444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef9223-74bf-4a76-9cba-d56202c7c964 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-adef9223-74bf-4a76-9cba-d56202c7c964 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:12:01.117076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:01.118236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:01.119120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:12:01.119120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:12:01.119120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:12:01.119120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:12:01.119120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:12:01.119120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:12:01.119120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:12:01.119120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:01.119120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 630/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:12:01.124432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c5978-f1c1-4c0b-8c66-1781fe7cb2c9 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:01.229797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c5978-f1c1-4c0b-8c66-1781fe7cb2c9 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:01.264119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171460f-ecbc-4f61-9389-4f4b68d183bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:01.267243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171460f-ecbc-4f61-9389-4f4b68d183bc None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:01.267243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171460f-ecbc-4f61-9389-4f4b68d183bc None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:01.267243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171460f-ecbc-4f61-9389-4f4b68d183bc None admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:01.267243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171460f-ecbc-4f61-9389-4f4b68d183bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:01.267243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171460f-ecbc-4f61-9389-4f4b68d183bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:01.268263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171460f-ecbc-4f61-9389-4f4b68d183bc None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:01.280874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 629/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:01.288490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef9223-74bf-4a76-9cba-d56202c7c964 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:01.314079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:01.389476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef9223-74bf-4a76-9cba-d56202c7c964 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:01.426777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d0f4d-5eb8-47a3-b7bc-1f0cce4ac6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:01.427671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0f4d-5eb8-47a3-b7bc-1f0cce4ac6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:01.428175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0f4d-5eb8-47a3-b7bc-1f0cce4ac6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:01.428504 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0f4d-5eb8-47a3-b7bc-1f0cce4ac6e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:01.429905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d0f4d-5eb8-47a3-b7bc-1f0cce4ac6e5 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=b98cb3da3efe49acbfe640366bf7b53b) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:01.430234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d0f4d-5eb8-47a3-b7bc-1f0cce4ac6e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:01.431675 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d0f4d-5eb8-47a3-b7bc-1f0cce4ac6e5 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:01.437565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 631/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:12:01 2022] GET /identity/v3/role_assignments?user.id=b98cb3da3efe49acbfe640366bf7b53b&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:03.338786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd7ce8-8d69-4f12-8b6f-df405d140ce1 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:03.339361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd7ce8-8d69-4f12-8b6f-df405d140ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:03.339361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd7ce8-8d69-4f12-8b6f-df405d140ce1 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:03.340746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 630/1261] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:03.345898 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77600cf1-8b2b-47be-bdde-dc5547b0f656 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:03.346302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77600cf1-8b2b-47be-bdde-dc5547b0f656 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:03.346465 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77600cf1-8b2b-47be-bdde-dc5547b0f656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:03.364892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-77600cf1-8b2b-47be-bdde-dc5547b0f656 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:03.366121 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-77600cf1-8b2b-47be-bdde-dc5547b0f656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:03.431719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 632/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:12:03.697538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd7ce8-8d69-4f12-8b6f-df405d140ce1 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:03.708316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:03.795730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd7ce8-8d69-4f12-8b6f-df405d140ce1 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:03.833879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a7f7c-8e7c-4446-93db-b394ace2da3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:03.834508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a7f7c-8e7c-4446-93db-b394ace2da3f None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:03.834788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a7f7c-8e7c-4446-93db-b394ace2da3f None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:03.835107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a7f7c-8e7c-4446-93db-b394ace2da3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:03.845535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a7f7c-8e7c-4446-93db-b394ace2da3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-594a7f7c-8e7c-4446-93db-b394ace2da3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:12:03.850286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:03.851411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:12:03.852635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 631/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:12:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:03.857388 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77600cf1-8b2b-47be-bdde-dc5547b0f656 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:03.876912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:03.956875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77600cf1-8b2b-47be-bdde-dc5547b0f656 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:03.990688 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2380b4d-f9a1-4bb6-a21a-9f6aec35d643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:03.991288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2380b4d-f9a1-4bb6-a21a-9f6aec35d643 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:03.991566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2380b4d-f9a1-4bb6-a21a-9f6aec35d643 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:03.992239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2380b4d-f9a1-4bb6-a21a-9f6aec35d643 None admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:03.992494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2380b4d-f9a1-4bb6-a21a-9f6aec35d643 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:03.992794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2380b4d-f9a1-4bb6-a21a-9f6aec35d643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:03.994286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2380b4d-f9a1-4bb6-a21a-9f6aec35d643 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:04.002721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 633/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:12:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:04.008586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a7f7c-8e7c-4446-93db-b394ace2da3f None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:04.092580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:04.125528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a7f7c-8e7c-4446-93db-b394ace2da3f None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:04.160141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9295cb5-654e-4fe0-b7c4-eaf1c66f785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:04.160770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9295cb5-654e-4fe0-b7c4-eaf1c66f785e None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:04.161049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9295cb5-654e-4fe0-b7c4-eaf1c66f785e None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:04.161321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9295cb5-654e-4fe0-b7c4-eaf1c66f785e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:04.171667 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9295cb5-654e-4fe0-b7c4-eaf1c66f785e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:04.173711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9295cb5-654e-4fe0-b7c4-eaf1c66f785e None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-e9295cb5-654e-4fe0-b7c4-eaf1c66f785e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:12:04.189911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:04.191296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:12:04.192224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:12:04.192224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:12:04.192224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:12:04.192224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 632/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:04.196896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2380b4d-f9a1-4bb6-a21a-9f6aec35d643 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:04.277577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:04.297254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2380b4d-f9a1-4bb6-a21a-9f6aec35d643 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:04.330300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb5c0-b090-4130-b939-85849c851ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:04.330897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb5c0-b090-4130-b939-85849c851ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:04.331178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb5c0-b090-4130-b939-85849c851ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:04.331452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb5c0-b090-4130-b939-85849c851ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:04.332090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb5c0-b090-4130-b939-85849c851ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:04.332395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb5c0-b090-4130-b939-85849c851ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:04.333904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb5c0-b090-4130-b939-85849c851ca6 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:04.346009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 634/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:04.351766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9295cb5-654e-4fe0-b7c4-eaf1c66f785e None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:04.451705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9295cb5-654e-4fe0-b7c4-eaf1c66f785e None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:04.472840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:04.486480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3025be-32b1-46ad-b53d-0fa8c9a41b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:04.487113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3025be-32b1-46ad-b53d-0fa8c9a41b75 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:04.487388 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3025be-32b1-46ad-b53d-0fa8c9a41b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:04.487662 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3025be-32b1-46ad-b53d-0fa8c9a41b75 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:04.495413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3025be-32b1-46ad-b53d-0fa8c9a41b75 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:04.496848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3025be-32b1-46ad-b53d-0fa8c9a41b75 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-fa3025be-32b1-46ad-b53d-0fa8c9a41b75 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:12:04.508709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:04.509882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:12:04.510822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 633/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:12:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:04.515840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb5c0-b090-4130-b939-85849c851ca6 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:04.620137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb5c0-b090-4130-b939-85849c851ca6 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:04.654529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3afb7-dff2-4715-ae5e-72231433cda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:04.655311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3afb7-dff2-4715-ae5e-72231433cda2 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:04.655588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3afb7-dff2-4715-ae5e-72231433cda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:04.655858 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3afb7-dff2-4715-ae5e-72231433cda2 None admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:04.656678 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3afb7-dff2-4715-ae5e-72231433cda2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:04.656983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3afb7-dff2-4715-ae5e-72231433cda2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:04.658989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3afb7-dff2-4715-ae5e-72231433cda2 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:04.667621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:04.676388 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 635/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 31 19:12:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:04.682270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3025be-32b1-46ad-b53d-0fa8c9a41b75 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:04.784595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3025be-32b1-46ad-b53d-0fa8c9a41b75 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:04.818519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793a1c7-b4a6-4d2a-b152-31c37912b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:04.819156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a1c7-b4a6-4d2a-b152-31c37912b88d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:04.819433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a1c7-b4a6-4d2a-b152-31c37912b88d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:04.819704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a1c7-b4a6-4d2a-b152-31c37912b88d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:04.830812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793a1c7-b4a6-4d2a-b152-31c37912b88d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:04.832241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793a1c7-b4a6-4d2a-b152-31c37912b88d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-4793a1c7-b4a6-4d2a-b152-31c37912b88d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:12:04.846366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:04.853322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:12:04.854538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:12:04.854538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:12:04.854538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:12:04.854538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 634/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:04.854826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3afb7-dff2-4715-ae5e-72231433cda2 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:04.953675 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3afb7-dff2-4715-ae5e-72231433cda2 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:04.987379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584b4a2-fbfe-457b-8d0a-99388dbc82ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:04.987977 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584b4a2-fbfe-457b-8d0a-99388dbc82ee None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:04.988263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584b4a2-fbfe-457b-8d0a-99388dbc82ee None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:04.988539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584b4a2-fbfe-457b-8d0a-99388dbc82ee None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:04.989177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584b4a2-fbfe-457b-8d0a-99388dbc82ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:04.989487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584b4a2-fbfe-457b-8d0a-99388dbc82ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:04.990903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584b4a2-fbfe-457b-8d0a-99388dbc82ee None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:05.001980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 636/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:05.007713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793a1c7-b4a6-4d2a-b152-31c37912b88d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:05.039206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:05.105482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793a1c7-b4a6-4d2a-b152-31c37912b88d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:05.138487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62399b-b78e-47b4-a29c-2fc9c9a35d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:05.139105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62399b-b78e-47b4-a29c-2fc9c9a35d46 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:05.139382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62399b-b78e-47b4-a29c-2fc9c9a35d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:05.139653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62399b-b78e-47b4-a29c-2fc9c9a35d46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:05.146649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62399b-b78e-47b4-a29c-2fc9c9a35d46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:05.148072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62399b-b78e-47b4-a29c-2fc9c9a35d46 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-7d62399b-b78e-47b4-a29c-2fc9c9a35d46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:12:05.159522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:05.164334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:05.165404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:12:05.165404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:12:05.165404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:12:05.165404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:12:05.165404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:12:05.165404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:12:05.165404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:12:05.165404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:12:05.165404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 635/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:05.166484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584b4a2-fbfe-457b-8d0a-99388dbc82ee None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:05.225762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:05.268718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584b4a2-fbfe-457b-8d0a-99388dbc82ee None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:05.302435 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80859e1e-6f06-40f1-83a7-fbb65fda9130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:05.303132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859e1e-6f06-40f1-83a7-fbb65fda9130 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:05.303428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859e1e-6f06-40f1-83a7-fbb65fda9130 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:05.303927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859e1e-6f06-40f1-83a7-fbb65fda9130 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:05.304674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80859e1e-6f06-40f1-83a7-fbb65fda9130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:05.304994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80859e1e-6f06-40f1-83a7-fbb65fda9130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:05.306579 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80859e1e-6f06-40f1-83a7-fbb65fda9130 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:05.321072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 637/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:05.327470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62399b-b78e-47b4-a29c-2fc9c9a35d46 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:05.422017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:05.429618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62399b-b78e-47b4-a29c-2fc9c9a35d46 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:05.463146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8175f55-5be7-4f01-b247-f6369c9941d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:05.463795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175f55-5be7-4f01-b247-f6369c9941d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:05.464071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175f55-5be7-4f01-b247-f6369c9941d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:05.464341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175f55-5be7-4f01-b247-f6369c9941d7 None admin] PATH_INFO: `/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/b98cb3da3efe49acbfe640366bf7b53b/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:05.466216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8175f55-5be7-4f01-b247-f6369c9941d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3617ea8d0850464ea4d15a7da1d8ce8a, user_id=b98cb3da3efe49acbfe640366bf7b53b, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:05.467634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8175f55-5be7-4f01-b247-f6369c9941d7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:05.603049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 636/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 31 19:12:05 2022] PUT /identity/v3/projects/3617ea8d0850464ea4d15a7da1d8ce8a/users/b98cb3da3efe49acbfe640366bf7b53b/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:12:07.485754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de34698-da45-4d03-afcf-dd5b6da12989 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:07.486434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de34698-da45-4d03-afcf-dd5b6da12989 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:07.486434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de34698-da45-4d03-afcf-dd5b6da12989 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:07.487636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 638/1274] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:07.492931 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df284-f5c9-4f57-8952-7207fe2ff8df None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:07.493369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df284-f5c9-4f57-8952-7207fe2ff8df None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:07.493614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df284-f5c9-4f57-8952-7207fe2ff8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:07.512550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e15df284-f5c9-4f57-8952-7207fe2ff8df None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:07.513727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e15df284-f5c9-4f57-8952-7207fe2ff8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:07.586074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 637/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:12:07.855931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de34698-da45-4d03-afcf-dd5b6da12989 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:07.961088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de34698-da45-4d03-afcf-dd5b6da12989 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:07.979676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:07.996503 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2483b-63ab-443e-85f1-752fcf431f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:07.997153 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2483b-63ab-443e-85f1-752fcf431f81 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:07.997487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2483b-63ab-443e-85f1-752fcf431f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:07.997802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2483b-63ab-443e-85f1-752fcf431f81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:08.009147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2483b-63ab-443e-85f1-752fcf431f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-bcd2483b-63ab-443e-85f1-752fcf431f81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:12:08.014176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:08.018589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:08.019712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 639/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 31 19:12:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:08.023023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15df284-f5c9-4f57-8952-7207fe2ff8df None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:08.111373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:08.129791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15df284-f5c9-4f57-8952-7207fe2ff8df None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:08.176093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68e06-7c68-4e7b-8854-831901c018e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:08.176890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68e06-7c68-4e7b-8854-831901c018e1 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:08.177190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68e06-7c68-4e7b-8854-831901c018e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:08.177605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68e06-7c68-4e7b-8854-831901c018e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:08.178721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d68e06-7c68-4e7b-8854-831901c018e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:08.179375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d68e06-7c68-4e7b-8854-831901c018e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:08.181766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d68e06-7c68-4e7b-8854-831901c018e1 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:08.192344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 638/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 31 19:12:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:08.198900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2483b-63ab-443e-85f1-752fcf431f81 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:08.300840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2483b-63ab-443e-85f1-752fcf431f81 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:08.334738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe1a50-119c-495d-801a-8067e1e48060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:08.335497 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe1a50-119c-495d-801a-8067e1e48060 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:08.335790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe1a50-119c-495d-801a-8067e1e48060 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:08.336043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe1a50-119c-495d-801a-8067e1e48060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:08.346390 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe1a50-119c-495d-801a-8067e1e48060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:08.347924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe1a50-119c-495d-801a-8067e1e48060 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-bdfe1a50-119c-495d-801a-8067e1e48060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:12:08.371152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:08.372408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:12:08.373524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:12:08.373524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:12:08.373524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:08.373524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 640/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:08.373816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68e06-7c68-4e7b-8854-831901c018e1 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:08.470430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68e06-7c68-4e7b-8854-831901c018e1 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:08.503295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ec3a-1d1a-492f-8298-d204ad31565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:08.503934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ec3a-1d1a-492f-8298-d204ad31565d None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:08.504151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ec3a-1d1a-492f-8298-d204ad31565d None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:08.504421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76ec3a-1d1a-492f-8298-d204ad31565d None admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:08.505049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76ec3a-1d1a-492f-8298-d204ad31565d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:08.505350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76ec3a-1d1a-492f-8298-d204ad31565d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:08.506855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76ec3a-1d1a-492f-8298-d204ad31565d None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:08.518843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 639/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:08.524620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe1a50-119c-495d-801a-8067e1e48060 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:08.554994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:08.627576 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe1a50-119c-495d-801a-8067e1e48060 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:08.660299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffef44-13ae-457b-ac2e-11356bb46c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:08.660920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffef44-13ae-457b-ac2e-11356bb46c3a None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:08.661227 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffef44-13ae-457b-ac2e-11356bb46c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:08.661565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffef44-13ae-457b-ac2e-11356bb46c3a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:08.668917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffef44-13ae-457b-ac2e-11356bb46c3a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:08.670353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffef44-13ae-457b-ac2e-11356bb46c3a None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-11ffef44-13ae-457b-ac2e-11356bb46c3a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:12:08.681819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:08.682932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:08.684090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 641/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:12:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:08.689585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ec3a-1d1a-492f-8298-d204ad31565d None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:08.694864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:08.797132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76ec3a-1d1a-492f-8298-d204ad31565d None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:08.836537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38a090-665a-44bd-a986-0e593fb527e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:08.837146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38a090-665a-44bd-a986-0e593fb527e7 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:08.837422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38a090-665a-44bd-a986-0e593fb527e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:08.837757 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38a090-665a-44bd-a986-0e593fb527e7 None admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:08.838492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38a090-665a-44bd-a986-0e593fb527e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:08.838796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38a090-665a-44bd-a986-0e593fb527e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:08.840279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38a090-665a-44bd-a986-0e593fb527e7 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:08.859676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 640/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 31 19:12:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:08.866222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffef44-13ae-457b-ac2e-11356bb46c3a None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:08.959524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:08.968943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffef44-13ae-457b-ac2e-11356bb46c3a None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:09.003718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dd7ef-528b-4216-8919-c814cf456ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:09.006319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd7ef-528b-4216-8919-c814cf456ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:09.006319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd7ef-528b-4216-8919-c814cf456ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:09.006319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd7ef-528b-4216-8919-c814cf456ef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:09.071711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dd7ef-528b-4216-8919-c814cf456ef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:09.073407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dd7ef-528b-4216-8919-c814cf456ef4 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:09.161514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:09.171421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 642/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 31 19:12:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:12:09.177984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38a090-665a-44bd-a986-0e593fb527e7 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:09.239755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:09.276459 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38a090-665a-44bd-a986-0e593fb527e7 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:09.309900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509dfb9-482f-4041-a397-0a6b0f9e9760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:09.310598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509dfb9-482f-4041-a397-0a6b0f9e9760 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:09.310879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509dfb9-482f-4041-a397-0a6b0f9e9760 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:09.311153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509dfb9-482f-4041-a397-0a6b0f9e9760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:09.320677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509dfb9-482f-4041-a397-0a6b0f9e9760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:09.322389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509dfb9-482f-4041-a397-0a6b0f9e9760 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-3509dfb9-482f-4041-a397-0a6b0f9e9760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:12:09.336837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:09.337904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:12:09.338789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:12:09.338789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:12:09.338789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:12:09.338789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 641/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:09.343752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dd7ef-528b-4216-8919-c814cf456ef4 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:09.445600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dd7ef-528b-4216-8919-c814cf456ef4 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:09.480641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb8218-4f54-44ad-a052-32c52e4af92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:09.481291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb8218-4f54-44ad-a052-32c52e4af92c None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:09.481574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb8218-4f54-44ad-a052-32c52e4af92c None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:09.481876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb8218-4f54-44ad-a052-32c52e4af92c None admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:09.482518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb8218-4f54-44ad-a052-32c52e4af92c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:09.482819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb8218-4f54-44ad-a052-32c52e4af92c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:09.484165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb8218-4f54-44ad-a052-32c52e4af92c None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:09.495352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 643/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 31 19:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:09.500996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509dfb9-482f-4041-a397-0a6b0f9e9760 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:09.606218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509dfb9-482f-4041-a397-0a6b0f9e9760 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:09.620514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:09.641020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4fed4-3b19-4de6-a4e3-9d31d2e2e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:09.641650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4fed4-3b19-4de6-a4e3-9d31d2e2e053 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:09.641959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4fed4-3b19-4de6-a4e3-9d31d2e2e053 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:09.642235 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4fed4-3b19-4de6-a4e3-9d31d2e2e053 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:09.649524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4fed4-3b19-4de6-a4e3-9d31d2e2e053 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:09.651029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4fed4-3b19-4de6-a4e3-9d31d2e2e053 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application [None req-4ad4fed4-3b19-4de6-a4e3-9d31d2e2e053 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:12:09.662849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:09.663936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:09.665017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:12:09.665017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:12:09.665017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:12:09.665017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:12:09.665017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:12:09.665017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:12:09.665017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:12:09.665017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: ERROR keystone.server.flask.application Aug 31 19:12:09.665017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 642/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 31 19:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:09.669773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb8218-4f54-44ad-a052-32c52e4af92c None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:09.722476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:09.771557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb8218-4f54-44ad-a052-32c52e4af92c None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:09.810640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c18b7b-eb9c-4638-adbe-69d70254c2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:09.811253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18b7b-eb9c-4638-adbe-69d70254c2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:09.811526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18b7b-eb9c-4638-adbe-69d70254c2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:09.811797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18b7b-eb9c-4638-adbe-69d70254c2f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:09.812538 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18b7b-eb9c-4638-adbe-69d70254c2f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:09.812897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18b7b-eb9c-4638-adbe-69d70254c2f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:09.814946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18b7b-eb9c-4638-adbe-69d70254c2f9 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:09.828131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 644/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 31 19:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:09.834911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4fed4-3b19-4de6-a4e3-9d31d2e2e053 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:09.940127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4fed4-3b19-4de6-a4e3-9d31d2e2e053 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:09.974676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8614c61-c198-44ec-96e0-f3252d1342e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:09.975353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8614c61-c198-44ec-96e0-f3252d1342e6 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:09.975624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8614c61-c198-44ec-96e0-f3252d1342e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:09.975893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8614c61-c198-44ec-96e0-f3252d1342e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:09.976623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8614c61-c198-44ec-96e0-f3252d1342e6 None admin] RBAC: Adding query filter params (role.id=d7a6b2a9ee8048d0879546334583d6fd, scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a, user.id=b98cb3da3efe49acbfe640366bf7b53b) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:09.976929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8614c61-c198-44ec-96e0-f3252d1342e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:09.978521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8614c61-c198-44ec-96e0-f3252d1342e6 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:09.984954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 643/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 31 19:12:09 2022] GET /identity/v3/role_assignments?user.id=b98cb3da3efe49acbfe640366bf7b53b&scope.project.id=3617ea8d0850464ea4d15a7da1d8ce8a&role.id=d7a6b2a9ee8048d0879546334583d6fd => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:11.967578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7105-85a2-4e56-be39-ae2233556e50 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:11.968120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7105-85a2-4e56-be39-ae2233556e50 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:11.968120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7105-85a2-4e56-be39-ae2233556e50 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:11.969498 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 645/1288] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:11.975181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40775b-f58d-42a9-8efb-870d8c5330d0 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:11.975600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40775b-f58d-42a9-8efb-870d8c5330d0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:11.975735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40775b-f58d-42a9-8efb-870d8c5330d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:11.994316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ae40775b-f58d-42a9-8efb-870d8c5330d0 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:11.995497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ae40775b-f58d-42a9-8efb-870d8c5330d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:12.030496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:12.068163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 644/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:12:12.344010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7105-85a2-4e56-be39-ae2233556e50 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:12.449092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7105-85a2-4e56-be39-ae2233556e50 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:12.462229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:12.485587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7c5b-4e33-46eb-9a44-72e5c039fa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:12.486763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7c5b-4e33-46eb-9a44-72e5c039fa58 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:12.487048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7c5b-4e33-46eb-9a44-72e5c039fa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:12.487326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7c5b-4e33-46eb-9a44-72e5c039fa58 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:12.487915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d7c5b-4e33-46eb-9a44-72e5c039fa58 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:12.489276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d7c5b-4e33-46eb-9a44-72e5c039fa58 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-6f6d7c5b-4e33-46eb-9a44-72e5c039fa58 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:12.499782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:12.501371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:12.503249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 646/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 31 19:12:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:12.507778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40775b-f58d-42a9-8efb-870d8c5330d0 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:12.622204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40775b-f58d-42a9-8efb-870d8c5330d0 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:12.657383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c2ebe-7621-416e-b46d-7e735550b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:12.658030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2ebe-7621-416e-b46d-7e735550b6ed None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:12.658311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2ebe-7621-416e-b46d-7e735550b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:12.658581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2ebe-7621-416e-b46d-7e735550b6ed None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:12.659206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2ebe-7621-416e-b46d-7e735550b6ed None admin] RBAC: Adding query filter params (name=placement) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:12.659501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2ebe-7621-416e-b46d-7e735550b6ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:12.660899 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2ebe-7621-416e-b46d-7e735550b6ed None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:12.665604 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 645/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 31 19:12:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:12.671466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7c5b-4e33-46eb-9a44-72e5c039fa58 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:12.778235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7c5b-4e33-46eb-9a44-72e5c039fa58 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:12.817561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9953e-1b80-4084-8839-218f0311b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:12.818218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9953e-1b80-4084-8839-218f0311b838 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:12.818500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9953e-1b80-4084-8839-218f0311b838 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:12.818768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9953e-1b80-4084-8839-218f0311b838 None admin] PATH_INFO: `/v3/services` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:12.819495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9953e-1b80-4084-8839-218f0311b838 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:12.819797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9953e-1b80-4084-8839-218f0311b838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:12.821249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9953e-1b80-4084-8839-218f0311b838 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:12.826050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 647/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 31 19:12:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:14.755794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9c70-1f9f-4cb3-9602-eef6f411df45 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:14.756500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9c70-1f9f-4cb3-9602-eef6f411df45 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:14.756500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9c70-1f9f-4cb3-9602-eef6f411df45 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:14.757839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 646/1293] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:14.763008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ee26-49cd-4642-be3a-2ea55d0b286a None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:14.763510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ee26-49cd-4642-be3a-2ea55d0b286a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:14.763615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ee26-49cd-4642-be3a-2ea55d0b286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:14.782076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-91f6ee26-49cd-4642-be3a-2ea55d0b286a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:14.784974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-91f6ee26-49cd-4642-be3a-2ea55d0b286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:14.813060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:14.852611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 648/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:12:15.119189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec9c70-1f9f-4cb3-9602-eef6f411df45 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:15.151122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:15.220393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec9c70-1f9f-4cb3-9602-eef6f411df45 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:15.255248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c514f8-d2a7-47b0-8943-c6476907bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:15.255851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c514f8-d2a7-47b0-8943-c6476907bfc5 None admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:15.256136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c514f8-d2a7-47b0-8943-c6476907bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:15.256407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c514f8-d2a7-47b0-8943-c6476907bfc5 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:15.257068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c514f8-d2a7-47b0-8943-c6476907bfc5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:15.258721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c514f8-d2a7-47b0-8943-c6476907bfc5 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:15.353820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 647/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 31 19:12:15 2022] POST /identity/v3/services => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:12:17.276066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faaef3-78d9-4d3d-9634-6a531c1c1183 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:17.276607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faaef3-78d9-4d3d-9634-6a531c1c1183 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:17.276702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faaef3-78d9-4d3d-9634-6a531c1c1183 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:17.278081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 649/1296] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:17.283149 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc86fd-3601-4105-8336-f1110578c340 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:17.283581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc86fd-3601-4105-8336-f1110578c340 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:17.283674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc86fd-3601-4105-8336-f1110578c340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:17.301177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-06dc86fd-3601-4105-8336-f1110578c340 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:17.302384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-06dc86fd-3601-4105-8336-f1110578c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:17.372358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 648/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:12:17.638188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faaef3-78d9-4d3d-9634-6a531c1c1183 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:17.738380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faaef3-78d9-4d3d-9634-6a531c1c1183 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:17.772638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62d357-7eae-41fe-b62c-6c5bee64355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:17.773266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d357-7eae-41fe-b62c-6c5bee64355f None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:17.773546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d357-7eae-41fe-b62c-6c5bee64355f None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:17.773848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d357-7eae-41fe-b62c-6c5bee64355f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:17.774438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62d357-7eae-41fe-b62c-6c5bee64355f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:17.775807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62d357-7eae-41fe-b62c-6c5bee64355f None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-eb62d357-7eae-41fe-b62c-6c5bee64355f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:17.784775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:17.785994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:17.786934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 650/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 31 19:12:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:17.792264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc86fd-3601-4105-8336-f1110578c340 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:17.812003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:17.894456 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc86fd-3601-4105-8336-f1110578c340 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:17.928070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd2433-52f2-4688-ad24-c00f245bac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:17.928674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd2433-52f2-4688-ad24-c00f245bac50 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:17.928958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd2433-52f2-4688-ad24-c00f245bac50 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:17.929227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd2433-52f2-4688-ad24-c00f245bac50 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:17.929889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd2433-52f2-4688-ad24-c00f245bac50 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:17.930193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd2433-52f2-4688-ad24-c00f245bac50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:17.931551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd2433-52f2-4688-ad24-c00f245bac50 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:17.936647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 649/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 31 19:12:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:17.943417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62d357-7eae-41fe-b62c-6c5bee64355f None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:17.975072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:18.040896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62d357-7eae-41fe-b62c-6c5bee64355f None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:18.076477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f4661-e825-4913-a722-455287f3e332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:18.077099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f4661-e825-4913-a722-455287f3e332 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:18.077384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f4661-e825-4913-a722-455287f3e332 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:18.077661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f4661-e825-4913-a722-455287f3e332 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:18.078618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f4661-e825-4913-a722-455287f3e332 None admin] RBAC: Adding query filter params (interface=public, service_id=be774b6903464a6c976dc088e916b9d7, region_id=RegionOne) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:18.078895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f4661-e825-4913-a722-455287f3e332 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:18.081112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f4661-e825-4913-a722-455287f3e332 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:18.086710 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 651/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 31 19:12:17 2022] GET /identity/v3/endpoints?service_id=be774b6903464a6c976dc088e916b9d7&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:12:18.092606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd2433-52f2-4688-ad24-c00f245bac50 None admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:18.177352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:18.195710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd2433-52f2-4688-ad24-c00f245bac50 None admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:18.230267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3c6ba-301a-4918-9e18-fde8ccdcf246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:18.230896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3c6ba-301a-4918-9e18-fde8ccdcf246 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:18.231171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3c6ba-301a-4918-9e18-fde8ccdcf246 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:18.231438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3c6ba-301a-4918-9e18-fde8ccdcf246 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:18.232101 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3c6ba-301a-4918-9e18-fde8ccdcf246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:18.233621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3c6ba-301a-4918-9e18-fde8ccdcf246 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:18.241340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 650/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 31 19:12:18 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:12:20.160006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1042c1b-4273-487c-b782-cec9b503da8b None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:20.160500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1042c1b-4273-487c-b782-cec9b503da8b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:20.160500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1042c1b-4273-487c-b782-cec9b503da8b None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:20.161861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 652/1302] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:20.167162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c344-ad9e-49d5-9f46-3805658695d7 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:20.167578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c344-ad9e-49d5-9f46-3805658695d7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:20.167716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c344-ad9e-49d5-9f46-3805658695d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:20.185533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-bfe4c344-ad9e-49d5-9f46-3805658695d7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:20.186742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-bfe4c344-ad9e-49d5-9f46-3805658695d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:20.252543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 651/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:12:20.525445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1042c1b-4273-487c-b782-cec9b503da8b None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:20.622726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:20.629826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1042c1b-4273-487c-b782-cec9b503da8b None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:20.663080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ad8b7-ff7d-4081-aa57-4000e5355001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:20.663703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ad8b7-ff7d-4081-aa57-4000e5355001 None admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:20.663982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ad8b7-ff7d-4081-aa57-4000e5355001 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:20.664256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ad8b7-ff7d-4081-aa57-4000e5355001 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:20.664843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ad8b7-ff7d-4081-aa57-4000e5355001 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:20.666228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ad8b7-ff7d-4081-aa57-4000e5355001 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application [None req-834ad8b7-ff7d-4081-aa57-4000e5355001 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:12:20.675367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:12:20.676564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application with Lock( Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: ERROR keystone.server.flask.application Aug 31 19:12:20.677838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 653/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 31 19:12:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:12:20.682440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4c344-ad9e-49d5-9f46-3805658695d7 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:20.761042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:20.783211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4c344-ad9e-49d5-9f46-3805658695d7 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:20.817322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096af78-d0f1-4c73-9094-3c619ac2f9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:20.817968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096af78-d0f1-4c73-9094-3c619ac2f9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:20.818242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096af78-d0f1-4c73-9094-3c619ac2f9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:20.818511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096af78-d0f1-4c73-9094-3c619ac2f9b4 None admin] PATH_INFO: `/v3/services` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:20.819141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096af78-d0f1-4c73-9094-3c619ac2f9b4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:12:20.819537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096af78-d0f1-4c73-9094-3c619ac2f9b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:20.820922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096af78-d0f1-4c73-9094-3c619ac2f9b4 None admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:20.827425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 652/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 31 19:12:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:12:20.834152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ad8b7-ff7d-4081-aa57-4000e5355001 None admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:20.935215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ad8b7-ff7d-4081-aa57-4000e5355001 None admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:20.967985 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de0190-1387-4eac-9ae8-92f9a55b7d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:20.968581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0190-1387-4eac-9ae8-92f9a55b7d04 None admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:20.968939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0190-1387-4eac-9ae8-92f9a55b7d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:20.969196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0190-1387-4eac-9ae8-92f9a55b7d04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:20.969887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de0190-1387-4eac-9ae8-92f9a55b7d04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:20.971722 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de0190-1387-4eac-9ae8-92f9a55b7d04 None admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:21.146395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 654/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:12:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:12:30.824317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=30 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:31.141591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:24.720431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f4d68-2150-4606-a541-b66168de7aa3 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:24.721426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f4d68-2150-4606-a541-b66168de7aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:24.721898 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f4d68-2150-4606-a541-b66168de7aa3 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:24.728864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95a4ff-cf70-4ecf-afb6-4f1a7f3401f4 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:24.729949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95a4ff-cf70-4ecf-afb6-4f1a7f3401f4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:24.730397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95a4ff-cf70-4ecf-afb6-4f1a7f3401f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:24.732640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 653/1307] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:24 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:24.829417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ea95a4ff-cf70-4ecf-afb6-4f1a7f3401f4 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:24.832471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ea95a4ff-cf70-4ecf-afb6-4f1a7f3401f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:25.105951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 655/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:25.416779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897828-9285-4eb8-8f9d-60fe9b21ad31 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:25.417148 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897828-9285-4eb8-8f9d-60fe9b21ad31 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:25.417488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897828-9285-4eb8-8f9d-60fe9b21ad31 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:25.418976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 654/1309] 10.222.0.42 () {54 vars in 965 bytes} [Wed Aug 31 19:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:25.428228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8c59-1a69-4c1d-bd2d-25910f06f5d5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:25.428590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8c59-1a69-4c1d-bd2d-25910f06f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:25.428963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8c59-1a69-4c1d-bd2d-25910f06f5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:25.519039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-eeee8c59-1a69-4c1d-bd2d-25910f06f5d5 None None] MFA Rules not processed for user `b263d1092fc148129020ba73f2b8fbd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:25.520262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-eeee8c59-1a69-4c1d-bd2d-25910f06f5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:25.554515 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:25.628434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 656/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Wed Aug 31 19:19:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:25.638262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4897828-9285-4eb8-8f9d-60fe9b21ad31 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:25.640274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e4897828-9285-4eb8-8f9d-60fe9b21ad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:25.755623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4897828-9285-4eb8-8f9d-60fe9b21ad31 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:25.878697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f107-a929-45bb-9a6a-fad0f4c0db47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:25.880121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f107-a929-45bb-9a6a-fad0f4c0db47 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:25.880626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f107-a929-45bb-9a6a-fad0f4c0db47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:25.881131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f107-a929-45bb-9a6a-fad0f4c0db47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:25.884399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fee3f107-a929-45bb-9a6a-fad0f4c0db47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:25.983966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:26.081874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3f107-a929-45bb-9a6a-fad0f4c0db47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:26.085646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3f107-a929-45bb-9a6a-fad0f4c0db47 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:26.125630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 655/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:28.405213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e609-13ad-414f-a83d-7c9fd5679afd None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:28.405213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e609-13ad-414f-a83d-7c9fd5679afd None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:28.406070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e609-13ad-414f-a83d-7c9fd5679afd None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:28.407220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 657/1312] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:28.412995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf43b9-04ac-45eb-aa7c-7e296845274e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:28.413524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf43b9-04ac-45eb-aa7c-7e296845274e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:28.413524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf43b9-04ac-45eb-aa7c-7e296845274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:28.493986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-2fbf43b9-04ac-45eb-aa7c-7e296845274e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:28.496103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2fbf43b9-04ac-45eb-aa7c-7e296845274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:28.606663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 656/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:19:28.889289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e609-13ad-414f-a83d-7c9fd5679afd None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:28.890876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-34c9e609-13ad-414f-a83d-7c9fd5679afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:29.003706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e609-13ad-414f-a83d-7c9fd5679afd None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:29.076112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:29.078470 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772bef1-29b1-48ea-bad4-a62802bdd7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:29.079071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772bef1-29b1-48ea-bad4-a62802bdd7df service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:29.079350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772bef1-29b1-48ea-bad4-a62802bdd7df service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:29.079623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772bef1-29b1-48ea-bad4-a62802bdd7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:29.081249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0772bef1-29b1-48ea-bad4-a62802bdd7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:29.206262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772bef1-29b1-48ea-bad4-a62802bdd7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:29.207709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772bef1-29b1-48ea-bad4-a62802bdd7df service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:29.227139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 658/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:31.726008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e023e2b-49eb-4953-838a-cdd8575fa400 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:31.726600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e023e2b-49eb-4953-838a-cdd8575fa400 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:31.726600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e023e2b-49eb-4953-838a-cdd8575fa400 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:31.727949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 657/1315] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:31.733375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab1881-f5f0-49ad-9943-f82ae48d7065 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:31.733846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab1881-f5f0-49ad-9943-f82ae48d7065 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:31.733983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab1881-f5f0-49ad-9943-f82ae48d7065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:31.800391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-14ab1881-f5f0-49ad-9943-f82ae48d7065 None None] MFA Rules not processed for user `ee10149ebbe7496c866e705d002c15a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:31.801585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-14ab1881-f5f0-49ad-9943-f82ae48d7065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:31.853496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:31.898014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 659/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:32.193581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524702-c6f8-4c32-a88e-e0de33ce6b6f None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:32.193927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524702-c6f8-4c32-a88e-e0de33ce6b6f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:32.194207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524702-c6f8-4c32-a88e-e0de33ce6b6f None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:32.195552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 658/1317] 10.222.0.42 () {54 vars in 965 bytes} [Wed Aug 31 19:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:32.201707 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0be17-23f1-451d-9b5d-2b9be256e809 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:32.201999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0be17-23f1-451d-9b5d-2b9be256e809 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:32.202282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0be17-23f1-451d-9b5d-2b9be256e809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:32.278406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9eb0be17-23f1-451d-9b5d-2b9be256e809 None None] MFA Rules not processed for user `b263d1092fc148129020ba73f2b8fbd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:32.279617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9eb0be17-23f1-451d-9b5d-2b9be256e809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:32.354200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 660/1318] 10.222.0.42 () {58 vars in 1062 bytes} [Wed Aug 31 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:32.363186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524702-c6f8-4c32-a88e-e0de33ce6b6f None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:32.364701 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c9524702-c6f8-4c32-a88e-e0de33ce6b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:32.374285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:32.465814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524702-c6f8-4c32-a88e-e0de33ce6b6f None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:32.537761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97bf64-349e-4071-8349-3e14300ec1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:32.538362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97bf64-349e-4071-8349-3e14300ec1ae service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:32.538647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97bf64-349e-4071-8349-3e14300ec1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:32.538908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97bf64-349e-4071-8349-3e14300ec1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:32.540524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cb97bf64-349e-4071-8349-3e14300ec1ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:32.602806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:32.650641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97bf64-349e-4071-8349-3e14300ec1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:32.651986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97bf64-349e-4071-8349-3e14300ec1ae service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:32.669934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 659/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:35.857752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd188e-a9e9-4b00-8c20-843b2380a0aa None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:35.858267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd188e-a9e9-4b00-8c20-843b2380a0aa None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:35.858362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd188e-a9e9-4b00-8c20-843b2380a0aa None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:35.859746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 661/1320] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:35.865058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37df91-b11a-4ad3-9a91-2500b883018c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:35.865465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37df91-b11a-4ad3-9a91-2500b883018c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:35.865613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37df91-b11a-4ad3-9a91-2500b883018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:35.930654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ca37df91-b11a-4ad3-9a91-2500b883018c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:35.931871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ca37df91-b11a-4ad3-9a91-2500b883018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:36.029266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 660/1321] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:36.314821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd188e-a9e9-4b00-8c20-843b2380a0aa None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:36.316376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-33fd188e-a9e9-4b00-8c20-843b2380a0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:36.368723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:36.427446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd188e-a9e9-4b00-8c20-843b2380a0aa None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:36.510241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02dab9-05c4-4566-9332-87928e934f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:36.510843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02dab9-05c4-4566-9332-87928e934f16 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:36.511119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02dab9-05c4-4566-9332-87928e934f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:36.511388 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02dab9-05c4-4566-9332-87928e934f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:36.512987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8b02dab9-05c4-4566-9332-87928e934f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:36.610277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:36.623861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02dab9-05c4-4566-9332-87928e934f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:36.625293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02dab9-05c4-4566-9332-87928e934f16 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:36.644747 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 662/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:39.653742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601929-c1b3-4c8a-ac56-e96ff7e98e44 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:39.654495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601929-c1b3-4c8a-ac56-e96ff7e98e44 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:39.654495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601929-c1b3-4c8a-ac56-e96ff7e98e44 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:39.655709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 661/1323] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:39.662428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f7d47-ebce-4f73-a986-08f99a434b4f None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:39.662975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f7d47-ebce-4f73-a986-08f99a434b4f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:39.662975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f7d47-ebce-4f73-a986-08f99a434b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:39.736676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a87f7d47-ebce-4f73-a986-08f99a434b4f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:39.738022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a87f7d47-ebce-4f73-a986-08f99a434b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:39.847320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 663/1324] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:40.135355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0601929-c1b3-4c8a-ac56-e96ff7e98e44 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:40.136957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e0601929-c1b3-4c8a-ac56-e96ff7e98e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:40.159044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:40.257402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0601929-c1b3-4c8a-ac56-e96ff7e98e44 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:40.334412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a311c3-5abf-48a5-87bd-eeafb762d56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:40.335014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a311c3-5abf-48a5-87bd-eeafb762d56f service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:40.335293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a311c3-5abf-48a5-87bd-eeafb762d56f service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:40.335565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a311c3-5abf-48a5-87bd-eeafb762d56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:40.337178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b7a311c3-5abf-48a5-87bd-eeafb762d56f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:40.417852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:40.458684 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a311c3-5abf-48a5-87bd-eeafb762d56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:40.460135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a311c3-5abf-48a5-87bd-eeafb762d56f service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:40.478247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 662/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:19:42.442620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c32a0-0313-4964-80fb-be5a86efe1c5 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:42.443163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c32a0-0313-4964-80fb-be5a86efe1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:42.443163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c32a0-0313-4964-80fb-be5a86efe1c5 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:42.444510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 664/1326] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:19:42.449870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35286d5-4b10-4dba-a997-0b81ffc7dd0e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:42.450292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35286d5-4b10-4dba-a997-0b81ffc7dd0e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:42.450434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35286d5-4b10-4dba-a997-0b81ffc7dd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:42.521420 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-b35286d5-4b10-4dba-a997-0b81ffc7dd0e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:42.523705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b35286d5-4b10-4dba-a997-0b81ffc7dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:42.625626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 663/1327] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:42.909358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c32a0-0313-4964-80fb-be5a86efe1c5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:42.910928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-883c32a0-0313-4964-80fb-be5a86efe1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:42.973204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:43.022632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c32a0-0313-4964-80fb-be5a86efe1c5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:43.098889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f37d7f-487c-43c9-8c90-2e2c2c505b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:43.099494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37d7f-487c-43c9-8c90-2e2c2c505b4f service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:43.099912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37d7f-487c-43c9-8c90-2e2c2c505b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:43.100179 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f37d7f-487c-43c9-8c90-2e2c2c505b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:43.101703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d0f37d7f-487c-43c9-8c90-2e2c2c505b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:43.223513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:43.225949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f37d7f-487c-43c9-8c90-2e2c2c505b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:43.227389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f37d7f-487c-43c9-8c90-2e2c2c505b4f service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:43.246512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 665/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:45.252151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fabbb-ca9b-47c2-bdd8-33714f89ca21 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:45.252672 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fabbb-ca9b-47c2-bdd8-33714f89ca21 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:45.252672 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fabbb-ca9b-47c2-bdd8-33714f89ca21 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:45.254120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 664/1329] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:45.259315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aeac2-150f-4dae-82ed-7ea9c46fd5fe None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:45.259765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aeac2-150f-4dae-82ed-7ea9c46fd5fe None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:45.259883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aeac2-150f-4dae-82ed-7ea9c46fd5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:45.328543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-8b1aeac2-150f-4dae-82ed-7ea9c46fd5fe None None] MFA Rules not processed for user `ee10149ebbe7496c866e705d002c15a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:45.329792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8b1aeac2-150f-4dae-82ed-7ea9c46fd5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:45.431125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 666/1330] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:45.724593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fabbb-ca9b-47c2-bdd8-33714f89ca21 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:45.726401 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-bf2fabbb-ca9b-47c2-bdd8-33714f89ca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:45.760337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:45.849200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fabbb-ca9b-47c2-bdd8-33714f89ca21 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:45.939465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8aacb9-97ca-4a8b-868a-a8660f54277d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:45.940079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aacb9-97ca-4a8b-868a-a8660f54277d service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:45.940352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aacb9-97ca-4a8b-868a-a8660f54277d service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:45.940624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aacb9-97ca-4a8b-868a-a8660f54277d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:45.942673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9b8aacb9-97ca-4a8b-868a-a8660f54277d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:46.026837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:46.058934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8aacb9-97ca-4a8b-868a-a8660f54277d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:46.060351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8aacb9-97ca-4a8b-868a-a8660f54277d service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:46.079434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 665/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:48.672066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2f78-f615-475c-92d9-dcd45f854b17 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:48.672611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2f78-f615-475c-92d9-dcd45f854b17 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:48.672611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d2f78-f615-475c-92d9-dcd45f854b17 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:48.674506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 667/1332] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:48.679980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e66d69-581b-4422-8dd0-6251858a182d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:48.680412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e66d69-581b-4422-8dd0-6251858a182d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:48.680538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e66d69-581b-4422-8dd0-6251858a182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:48.748354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-f9e66d69-581b-4422-8dd0-6251858a182d None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:48.749591 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f9e66d69-581b-4422-8dd0-6251858a182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:48.848651 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 666/1333] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:49.129315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d2f78-f615-475c-92d9-dcd45f854b17 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:49.130914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ab8d2f78-f615-475c-92d9-dcd45f854b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:49.198532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:49.233651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d2f78-f615-475c-92d9-dcd45f854b17 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:49.306079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212f42d-6634-4f5a-93dd-3af2918b7677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:49.306691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f42d-6634-4f5a-93dd-3af2918b7677 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:49.306972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f42d-6634-4f5a-93dd-3af2918b7677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:49.307248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f42d-6634-4f5a-93dd-3af2918b7677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:49.308878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a212f42d-6634-4f5a-93dd-3af2918b7677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:49.419110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212f42d-6634-4f5a-93dd-3af2918b7677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:49.420465 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212f42d-6634-4f5a-93dd-3af2918b7677 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:49.430256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:49.438197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 668/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:51.388913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d3669-15a8-42e1-a3bd-f59b5013f395 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:51.389465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d3669-15a8-42e1-a3bd-f59b5013f395 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:51.389620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d3669-15a8-42e1-a3bd-f59b5013f395 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:51.391178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 667/1335] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:51.396760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7c448-c19d-41c0-a75e-32a9aa2c98f1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:51.397254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7c448-c19d-41c0-a75e-32a9aa2c98f1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:51.397358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7c448-c19d-41c0-a75e-32a9aa2c98f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:51.466456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-8ba7c448-c19d-41c0-a75e-32a9aa2c98f1 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:51.467690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8ba7c448-c19d-41c0-a75e-32a9aa2c98f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:51.564111 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 669/1336] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:51.843393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d3669-15a8-42e1-a3bd-f59b5013f395 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:51.845494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-727d3669-15a8-42e1-a3bd-f59b5013f395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:51.888516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:51.951953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d3669-15a8-42e1-a3bd-f59b5013f395 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:52.024074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432897aa-59fb-452d-a6d2-69314feed4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:52.024670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432897aa-59fb-452d-a6d2-69314feed4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:52.024943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432897aa-59fb-452d-a6d2-69314feed4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:52.025219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432897aa-59fb-452d-a6d2-69314feed4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:52.026860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-432897aa-59fb-452d-a6d2-69314feed4d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:52.110519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:52.135338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432897aa-59fb-452d-a6d2-69314feed4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:52.136765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432897aa-59fb-452d-a6d2-69314feed4d8 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:52.155559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 668/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:54.712082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1585-ae00-4738-a5f4-236dd522359d None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:54.712612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1585-ae00-4738-a5f4-236dd522359d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:54.712612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e1585-ae00-4738-a5f4-236dd522359d None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:54.714116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 670/1338] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:54.720088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9c87-7e98-4459-a6f3-93f48cb0d010 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:54.720623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9c87-7e98-4459-a6f3-93f48cb0d010 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:54.720787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9c87-7e98-4459-a6f3-93f48cb0d010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:54.785932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-d01f9c87-7e98-4459-a6f3-93f48cb0d010 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:54.787129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d01f9c87-7e98-4459-a6f3-93f48cb0d010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:54.884111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 669/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:55.169935 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e1585-ae00-4738-a5f4-236dd522359d None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:55.173571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bf9e1585-ae00-4738-a5f4-236dd522359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:55.249220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:55.280297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e1585-ae00-4738-a5f4-236dd522359d None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:55.357397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ccdea-fd6c-4199-89d1-16b421977342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:55.358034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ccdea-fd6c-4199-89d1-16b421977342 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:55.358363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ccdea-fd6c-4199-89d1-16b421977342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:55.358617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ccdea-fd6c-4199-89d1-16b421977342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:55.360260 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-135ccdea-fd6c-4199-89d1-16b421977342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:55.467726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ccdea-fd6c-4199-89d1-16b421977342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:55.469203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ccdea-fd6c-4199-89d1-16b421977342 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:55.487737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 671/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:59.581827 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778124b-afc8-4e3c-a9e7-75f7f9e3cc7a None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:59.582326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778124b-afc8-4e3c-a9e7-75f7f9e3cc7a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:59.582519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778124b-afc8-4e3c-a9e7-75f7f9e3cc7a None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:59.583762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 670/1341] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:59.589335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781ae0f-59f8-4c85-b2a2-a9cd47ca54ab None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:59.589871 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781ae0f-59f8-4c85-b2a2-a9cd47ca54ab None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:59.590038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781ae0f-59f8-4c85-b2a2-a9cd47ca54ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:59.596281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:59.665371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a781ae0f-59f8-4c85-b2a2-a9cd47ca54ab None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:59.666658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a781ae0f-59f8-4c85-b2a2-a9cd47ca54ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:59.779810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 672/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:00.060850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778124b-afc8-4e3c-a9e7-75f7f9e3cc7a None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:00.062574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5778124b-afc8-4e3c-a9e7-75f7f9e3cc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:00.112135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:00.168068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778124b-afc8-4e3c-a9e7-75f7f9e3cc7a None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:00.240621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3d11a-7375-43a4-a89d-90e7d470388b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:00.241222 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3d11a-7375-43a4-a89d-90e7d470388b service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.241497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3d11a-7375-43a4-a89d-90e7d470388b service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.241799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3d11a-7375-43a4-a89d-90e7d470388b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.243404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-46a3d11a-7375-43a4-a89d-90e7d470388b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:00.339126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:00.355369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3d11a-7375-43a4-a89d-90e7d470388b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:00.356813 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3d11a-7375-43a4-a89d-90e7d470388b service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:00.385872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 671/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:03.311183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365268e-7b66-48a4-856d-6e843cec2444 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:03.311705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365268e-7b66-48a4-856d-6e843cec2444 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:03.311825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365268e-7b66-48a4-856d-6e843cec2444 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:03.313106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 673/1344] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:03.318430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86477-952f-4fed-8732-34f72210679e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:03.318855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86477-952f-4fed-8732-34f72210679e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:03.319075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86477-952f-4fed-8732-34f72210679e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:03.388571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-65f86477-952f-4fed-8732-34f72210679e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:03.390102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-65f86477-952f-4fed-8732-34f72210679e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:03.487463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 672/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:03.770733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365268e-7b66-48a4-856d-6e843cec2444 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:03.772334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a365268e-7b66-48a4-856d-6e843cec2444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:03.871405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:03.888547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365268e-7b66-48a4-856d-6e843cec2444 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:03.963367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc3f66-9a67-460f-a83e-ca8c29e90e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:03.963971 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc3f66-9a67-460f-a83e-ca8c29e90e79 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:03.964251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc3f66-9a67-460f-a83e-ca8c29e90e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:03.964529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc3f66-9a67-460f-a83e-ca8c29e90e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:03.966175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-08bc3f66-9a67-460f-a83e-ca8c29e90e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:04.078070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc3f66-9a67-460f-a83e-ca8c29e90e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:04.079562 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc3f66-9a67-460f-a83e-ca8c29e90e79 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:04.101256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 674/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:08.361520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515817a-3b3a-4c77-b416-628e007c9896 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:08.362079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515817a-3b3a-4c77-b416-628e007c9896 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:08.362079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515817a-3b3a-4c77-b416-628e007c9896 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:08.363873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 673/1347] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:08.369016 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08642b15-11a6-412f-8fb2-37fd1bb9e561 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:08.369463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08642b15-11a6-412f-8fb2-37fd1bb9e561 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:08.369811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08642b15-11a6-412f-8fb2-37fd1bb9e561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:08.389521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:08.456054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-08642b15-11a6-412f-8fb2-37fd1bb9e561 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:08.457559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-08642b15-11a6-412f-8fb2-37fd1bb9e561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:08.577759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 675/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:08.857995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515817a-3b3a-4c77-b416-628e007c9896 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:08.859574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5515817a-3b3a-4c77-b416-628e007c9896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:08.928630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:08.980884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515817a-3b3a-4c77-b416-628e007c9896 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:09.056049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e833d-04e0-40a8-8095-ad0ac944c6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:09.056654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e833d-04e0-40a8-8095-ad0ac944c6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:09.056937 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e833d-04e0-40a8-8095-ad0ac944c6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:09.057214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e833d-04e0-40a8-8095-ad0ac944c6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:09.058865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f83e833d-04e0-40a8-8095-ad0ac944c6b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:09.164566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:09.168083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e833d-04e0-40a8-8095-ad0ac944c6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:09.169554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e833d-04e0-40a8-8095-ad0ac944c6b8 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:09.187083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 674/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:14.228489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ccf35-7455-4953-b5b5-879b20e51bd2 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:14.229140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ccf35-7455-4953-b5b5-879b20e51bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:14.229334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ccf35-7455-4953-b5b5-879b20e51bd2 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:14.232130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 676/1350] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:14.239073 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4cd8-e8ba-483f-9e62-2911673c9cdc None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:14.239930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4cd8-e8ba-483f-9e62-2911673c9cdc None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:14.240372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4cd8-e8ba-483f-9e62-2911673c9cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:14.369301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-385e4cd8-e8ba-483f-9e62-2911673c9cdc None None] MFA Rules not processed for user `b98cb3da3efe49acbfe640366bf7b53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:14.371058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-385e4cd8-e8ba-483f-9e62-2911673c9cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:14.505978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 675/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:20:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:18.572177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=59 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:18.678479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac0b0b-fea2-4aa3-b6ee-9a279b98bd4e None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:18.678766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac0b0b-fea2-4aa3-b6ee-9a279b98bd4e None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:18.679339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac0b0b-fea2-4aa3-b6ee-9a279b98bd4e None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:18.680816 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 677/1352] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:18.686427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226e1fc-dd0e-408f-a4f2-316ba207da10 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:18.687166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226e1fc-dd0e-408f-a4f2-316ba207da10 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:18.687166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226e1fc-dd0e-408f-a4f2-316ba207da10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:18.749761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:18.776131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1226e1fc-dd0e-408f-a4f2-316ba207da10 None None] MFA Rules not processed for user `b98cb3da3efe49acbfe640366bf7b53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:18.777570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1226e1fc-dd0e-408f-a4f2-316ba207da10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:18.933993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 676/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:20:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:20.412814 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3af39-69a3-4f4f-9508-dd147e975ea6 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:20.413322 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3af39-69a3-4f4f-9508-dd147e975ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:20.413415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3af39-69a3-4f4f-9508-dd147e975ea6 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:20.414765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 678/1354] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:20.420170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369e5aa-9a11-4b63-ad1d-9156d94070f9 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:20.420617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369e5aa-9a11-4b63-ad1d-9156d94070f9 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:20.420874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369e5aa-9a11-4b63-ad1d-9156d94070f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:20.500664 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5369e5aa-9a11-4b63-ad1d-9156d94070f9 None None] MFA Rules not processed for user `b98cb3da3efe49acbfe640366bf7b53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:20.501921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5369e5aa-9a11-4b63-ad1d-9156d94070f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:20.550429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:20.621944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 677/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:20:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:23.985768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d45e-c7be-4373-831f-e369dac30593 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:23.986298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d45e-c7be-4373-831f-e369dac30593 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:23.986298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288d45e-c7be-4373-831f-e369dac30593 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:23.987653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 679/1356] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:23.992955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18da0d-41d5-41dc-8387-76468278280a None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:23.993453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18da0d-41d5-41dc-8387-76468278280a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:23.993598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18da0d-41d5-41dc-8387-76468278280a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.079454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9a18da0d-41d5-41dc-8387-76468278280a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:24.080973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9a18da0d-41d5-41dc-8387-76468278280a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:24.206566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 678/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:24.517826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5ea3-3d75-4ec4-8afd-bda399f4b4eb None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.518443 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5ea3-3d75-4ec4-8afd-bda399f4b4eb None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.518960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5ea3-3d75-4ec4-8afd-bda399f4b4eb None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.520929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 680/1358] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 31 19:20:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:24.528157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bda15-2aa6-48d6-b7f1-34996fa534c7 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.528447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bda15-2aa6-48d6-b7f1-34996fa534c7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.528725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bda15-2aa6-48d6-b7f1-34996fa534c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.554541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:24.628859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ed8bda15-2aa6-48d6-b7f1-34996fa534c7 None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:24.630522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ed8bda15-2aa6-48d6-b7f1-34996fa534c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:24.749037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 679/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 31 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:24.757703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd5ea3-3d75-4ec4-8afd-bda399f4b4eb None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:24.759317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-dacd5ea3-3d75-4ec4-8afd-bda399f4b4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:24.926009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd5ea3-3d75-4ec4-8afd-bda399f4b4eb None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:25.007110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:25.049854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e82b0a-5a77-4478-85fa-0fc3e56a8e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:25.050622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e82b0a-5a77-4478-85fa-0fc3e56a8e1c service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:25.050906 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e82b0a-5a77-4478-85fa-0fc3e56a8e1c service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:25.051176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e82b0a-5a77-4478-85fa-0fc3e56a8e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:25.052799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-68e82b0a-5a77-4478-85fa-0fc3e56a8e1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:25.147411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e82b0a-5a77-4478-85fa-0fc3e56a8e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:25.153252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e82b0a-5a77-4478-85fa-0fc3e56a8e1c service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:25.172695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 681/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:27.319981 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72adc6-6f6d-4bb8-b66d-588d16116e97 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:27.320985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72adc6-6f6d-4bb8-b66d-588d16116e97 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:27.320985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72adc6-6f6d-4bb8-b66d-588d16116e97 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:27.322136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 680/1361] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:27.327852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7d006-9c52-45aa-a049-5fa611b01400 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:27.328554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7d006-9c52-45aa-a049-5fa611b01400 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:27.328554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7d006-9c52-45aa-a049-5fa611b01400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:27.403585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-47b7d006-9c52-45aa-a049-5fa611b01400 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:27.404821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-47b7d006-9c52-45aa-a049-5fa611b01400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:27.446540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:27.507754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 682/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:27.798616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72adc6-6f6d-4bb8-b66d-588d16116e97 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:27.800128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cc72adc6-6f6d-4bb8-b66d-588d16116e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:27.881071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:27.981272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72adc6-6f6d-4bb8-b66d-588d16116e97 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:28.110210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc075c-14c2-4ed1-8f9a-64c15f8403fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:28.110860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc075c-14c2-4ed1-8f9a-64c15f8403fc service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:28.111146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc075c-14c2-4ed1-8f9a-64c15f8403fc service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:28.111422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc075c-14c2-4ed1-8f9a-64c15f8403fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:28.113106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6cdc075c-14c2-4ed1-8f9a-64c15f8403fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:28.139702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:28.216170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc075c-14c2-4ed1-8f9a-64c15f8403fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:28.218237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc075c-14c2-4ed1-8f9a-64c15f8403fc service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:28.242144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 681/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:30.686910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812270c-c610-45ca-b98a-4ba4f3d5244b None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:30.687511 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812270c-c610-45ca-b98a-4ba4f3d5244b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:30.687511 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812270c-c610-45ca-b98a-4ba4f3d5244b None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:30.688872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 683/1364] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:30.694592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4d276-c8d4-4378-8146-8cae169bc926 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:30.695488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4d276-c8d4-4378-8146-8cae169bc926 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:30.695818 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4d276-c8d4-4378-8146-8cae169bc926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:30.772660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-98a4d276-c8d4-4378-8146-8cae169bc926 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:30.773913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-98a4d276-c8d4-4378-8146-8cae169bc926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:30.889098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:30.897237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 682/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:31.191445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e92e0-e105-46cc-8bc8-36ac7c1c460f None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:31.191774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e92e0-e105-46cc-8bc8-36ac7c1c460f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:31.192065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e92e0-e105-46cc-8bc8-36ac7c1c460f None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:31.193621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 684/1366] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 31 19:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:31.199256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6af9b-6ecb-4412-87e2-87d9e741aaaf None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:31.199611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6af9b-6ecb-4412-87e2-87d9e741aaaf None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:31.201027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6af9b-6ecb-4412-87e2-87d9e741aaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:31.306128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-66f6af9b-6ecb-4412-87e2-87d9e741aaaf None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:31.307678 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-66f6af9b-6ecb-4412-87e2-87d9e741aaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:31.459846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 683/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 31 19:20:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:31.467951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e92e0-e105-46cc-8bc8-36ac7c1c460f None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:31.469647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c83e92e0-e105-46cc-8bc8-36ac7c1c460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:31.652731 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e92e0-e105-46cc-8bc8-36ac7c1c460f None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:31.680249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:31.783867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00154b8-c99d-42e8-9d32-6de1f2f527b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:31.784952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00154b8-c99d-42e8-9d32-6de1f2f527b5 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:31.784952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00154b8-c99d-42e8-9d32-6de1f2f527b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:31.784952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00154b8-c99d-42e8-9d32-6de1f2f527b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:31.786529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d00154b8-c99d-42e8-9d32-6de1f2f527b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:31.914993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00154b8-c99d-42e8-9d32-6de1f2f527b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:31.916628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00154b8-c99d-42e8-9d32-6de1f2f527b5 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:31.936819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 685/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:32.457082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cffb8-fbb8-4566-817f-89ba3f575d96 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:32.458143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cffb8-fbb8-4566-817f-89ba3f575d96 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:32.458143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cffb8-fbb8-4566-817f-89ba3f575d96 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:32.459227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 684/1369] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:20:32.464742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547b078-d2cd-4780-8cce-2b062b60573c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:32.465034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547b078-d2cd-4780-8cce-2b062b60573c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:32.465310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547b078-d2cd-4780-8cce-2b062b60573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:32.503112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:32.559389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9547b078-d2cd-4780-8cce-2b062b60573c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:32.565269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9547b078-d2cd-4780-8cce-2b062b60573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:32.676485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 686/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:33.264608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48698f3f-8c55-4427-9c27-3effbebdd76d None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:33.264608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48698f3f-8c55-4427-9c27-3effbebdd76d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:33.264608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48698f3f-8c55-4427-9c27-3effbebdd76d None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:33.268002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 685/1371] 10.222.0.42 () {54 vars in 964 bytes} [Wed Aug 31 19:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:33.271492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828f617-8156-4b73-87da-a0a4548287f3 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:33.272076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828f617-8156-4b73-87da-a0a4548287f3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:33.272076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828f617-8156-4b73-87da-a0a4548287f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:33.354594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-6828f617-8156-4b73-87da-a0a4548287f3 None None] MFA Rules not processed for user `953c57f22b304dcda6fcaba3fb01d666`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:33.355850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6828f617-8156-4b73-87da-a0a4548287f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:33.403600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:33.434925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 687/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Aug 31 19:20:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:33.443246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48698f3f-8c55-4427-9c27-3effbebdd76d None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:33.444782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-48698f3f-8c55-4427-9c27-3effbebdd76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:33.500507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:33.562462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48698f3f-8c55-4427-9c27-3effbebdd76d None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:33.644641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8df6a-e001-4828-91e5-370264cbdecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:33.645259 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8df6a-e001-4828-91e5-370264cbdecf service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:33.645856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8df6a-e001-4828-91e5-370264cbdecf service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:33.645856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8df6a-e001-4828-91e5-370264cbdecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:33.647564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4aa8df6a-e001-4828-91e5-370264cbdecf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:33.755525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:33.774469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8df6a-e001-4828-91e5-370264cbdecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:33.776146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8df6a-e001-4828-91e5-370264cbdecf service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:33.801411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 686/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:20:34.139317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c790f3-4a7e-4565-bb7a-4e174de8f0cb None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:34.139600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c790f3-4a7e-4565-bb7a-4e174de8f0cb None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:34.139884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c790f3-4a7e-4565-bb7a-4e174de8f0cb None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:34.141175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 688/1374] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:34.146564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0dd1e-ac5d-4152-a39a-caa1c0859df4 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:34.146955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0dd1e-ac5d-4152-a39a-caa1c0859df4 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:34.147138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0dd1e-ac5d-4152-a39a-caa1c0859df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:34.235815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-56b0dd1e-ac5d-4152-a39a-caa1c0859df4 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:34.237084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-56b0dd1e-ac5d-4152-a39a-caa1c0859df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:34.336248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 687/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:34.628923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c790f3-4a7e-4565-bb7a-4e174de8f0cb None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:34.630494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c7c790f3-4a7e-4565-bb7a-4e174de8f0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:34.777294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c790f3-4a7e-4565-bb7a-4e174de8f0cb None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:34.835548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:34.903868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a2914-4487-4e27-9343-dc502343acb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:34.904393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2914-4487-4e27-9343-dc502343acb3 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:34.904675 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2914-4487-4e27-9343-dc502343acb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:34.904950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2914-4487-4e27-9343-dc502343acb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:34.907241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-865a2914-4487-4e27-9343-dc502343acb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:35.003089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a2914-4487-4e27-9343-dc502343acb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:35.004687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a2914-4487-4e27-9343-dc502343acb3 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:35.023254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 689/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:37.134184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde560e3-0b1d-49b4-9711-4d64d77370a7 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:37.134654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde560e3-0b1d-49b4-9711-4d64d77370a7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:37.134654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde560e3-0b1d-49b4-9711-4d64d77370a7 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:37.136318 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 688/1377] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:37.141774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce295440-6256-417f-8a4c-cd71cde9c5bb None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:37.142356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce295440-6256-417f-8a4c-cd71cde9c5bb None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:37.142356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce295440-6256-417f-8a4c-cd71cde9c5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:37.212324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ce295440-6256-417f-8a4c-cd71cde9c5bb None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:37.213546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ce295440-6256-417f-8a4c-cd71cde9c5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:37.220370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:37.318699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 690/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:37.623494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde560e3-0b1d-49b4-9711-4d64d77370a7 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:37.625068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cde560e3-0b1d-49b4-9711-4d64d77370a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:37.691054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:37.785207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde560e3-0b1d-49b4-9711-4d64d77370a7 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:37.911128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5dfab-dcb9-4846-b725-33e64ce0703b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:37.911748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5dfab-dcb9-4846-b725-33e64ce0703b service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:37.912020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5dfab-dcb9-4846-b725-33e64ce0703b service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:37.912296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5dfab-dcb9-4846-b725-33e64ce0703b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:37.913961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-92b5dfab-dcb9-4846-b725-33e64ce0703b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:37.933892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:38.009458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5dfab-dcb9-4846-b725-33e64ce0703b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:38.011017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5dfab-dcb9-4846-b725-33e64ce0703b service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:38.032995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 689/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:40.238148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1275-524f-4de9-a298-26d99c6d5e0f None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:40.238699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1275-524f-4de9-a298-26d99c6d5e0f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:40.238699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1275-524f-4de9-a298-26d99c6d5e0f None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:40.240228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 691/1380] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:40.245428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eaa9e-fe81-46da-aa91-df33579055bb None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:40.245893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eaa9e-fe81-46da-aa91-df33579055bb None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:40.246589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eaa9e-fe81-46da-aa91-df33579055bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:40.325889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4a5eaa9e-fe81-46da-aa91-df33579055bb None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:40.327796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4a5eaa9e-fe81-46da-aa91-df33579055bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:40.441165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:40.451045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 690/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:40.737444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1275-524f-4de9-a298-26d99c6d5e0f None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:40.739129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2efd1275-524f-4de9-a298-26d99c6d5e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:40.900398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:40.913220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1275-524f-4de9-a298-26d99c6d5e0f None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:41.040343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9ac50-c1ba-445f-9a49-7b9ac3bbfcdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:41.040867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ac50-c1ba-445f-9a49-7b9ac3bbfcdb service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:41.041144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ac50-c1ba-445f-9a49-7b9ac3bbfcdb service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:41.041416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ac50-c1ba-445f-9a49-7b9ac3bbfcdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:41.043046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-dde9ac50-c1ba-445f-9a49-7b9ac3bbfcdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:41.138556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9ac50-c1ba-445f-9a49-7b9ac3bbfcdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:41.140789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9ac50-c1ba-445f-9a49-7b9ac3bbfcdb service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:41.151992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:41.161170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 692/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:43.598806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7b28-b5bd-48fd-a4db-daa249550f10 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:43.599370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7b28-b5bd-48fd-a4db-daa249550f10 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:43.599370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7b28-b5bd-48fd-a4db-daa249550f10 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:43.600777 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 691/1383] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:43.606944 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce8edd-9c4a-47fd-8bb0-36878a33b138 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:43.607610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce8edd-9c4a-47fd-8bb0-36878a33b138 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:43.607728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce8edd-9c4a-47fd-8bb0-36878a33b138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:43.688399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-f2ce8edd-9c4a-47fd-8bb0-36878a33b138 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:43.689686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f2ce8edd-9c4a-47fd-8bb0-36878a33b138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:43.798961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 693/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:44.082639 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7b28-b5bd-48fd-a4db-daa249550f10 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:44.084198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-485b7b28-b5bd-48fd-a4db-daa249550f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:44.262520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7b28-b5bd-48fd-a4db-daa249550f10 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:44.350411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:44.401238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae97dbf-a3ff-4ebb-b605-822718842534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:44.401897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae97dbf-a3ff-4ebb-b605-822718842534 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:44.402182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae97dbf-a3ff-4ebb-b605-822718842534 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:44.402458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae97dbf-a3ff-4ebb-b605-822718842534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:44.404157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fae97dbf-a3ff-4ebb-b605-822718842534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:44.523068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae97dbf-a3ff-4ebb-b605-822718842534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:44.523068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae97dbf-a3ff-4ebb-b605-822718842534 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:44.535500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 692/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:20:46.526585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1548786-ca82-44dd-a8db-c04019c056a9 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:46.527672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1548786-ca82-44dd-a8db-c04019c056a9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:46.527672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1548786-ca82-44dd-a8db-c04019c056a9 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:46.528606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 694/1386] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:46.535185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11020-bded-46fd-bc4b-cc889965d3bb None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:46.536143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11020-bded-46fd-bc4b-cc889965d3bb None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:46.536143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11020-bded-46fd-bc4b-cc889965d3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:46.619288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-08b11020-bded-46fd-bc4b-cc889965d3bb None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:46.620559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-08b11020-bded-46fd-bc4b-cc889965d3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:46.661811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:46.743259 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 693/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:47.041041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1548786-ca82-44dd-a8db-c04019c056a9 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:47.042623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b1548786-ca82-44dd-a8db-c04019c056a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:47.152570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:47.246278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1548786-ca82-44dd-a8db-c04019c056a9 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:47.374239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d26567-8db1-405f-8111-655ce015993c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:47.375357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d26567-8db1-405f-8111-655ce015993c service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:47.375639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d26567-8db1-405f-8111-655ce015993c service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:47.376063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d26567-8db1-405f-8111-655ce015993c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:47.377550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-43d26567-8db1-405f-8111-655ce015993c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:47.417526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:47.473152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d26567-8db1-405f-8111-655ce015993c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:47.474881 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d26567-8db1-405f-8111-655ce015993c service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:47.495933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 695/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:20:49.347690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c918b6-90f1-4f75-97a0-9fbcd29f8796 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:49.348475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c918b6-90f1-4f75-97a0-9fbcd29f8796 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:49.348475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c918b6-90f1-4f75-97a0-9fbcd29f8796 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:49.349720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 694/1389] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:49.355536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f10ee2-51ef-410b-ae7b-c032d08706ab None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:49.356223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f10ee2-51ef-410b-ae7b-c032d08706ab None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:49.356223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f10ee2-51ef-410b-ae7b-c032d08706ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:49.429948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e7f10ee2-51ef-410b-ae7b-c032d08706ab None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:49.431272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e7f10ee2-51ef-410b-ae7b-c032d08706ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:49.544478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 696/1390] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:49.691444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63d1ff-1d48-4802-b987-f143cfd9105d None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:49.691801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63d1ff-1d48-4802-b987-f143cfd9105d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:49.692082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63d1ff-1d48-4802-b987-f143cfd9105d None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:49.693520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 695/1391] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:49.699123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790dd72-f78a-4936-aeee-7008caa17df8 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:49.699415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790dd72-f78a-4936-aeee-7008caa17df8 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:49.699703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790dd72-f78a-4936-aeee-7008caa17df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:49.717599 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:49.771384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-2790dd72-f78a-4936-aeee-7008caa17df8 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:49.772630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2790dd72-f78a-4936-aeee-7008caa17df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:49.846185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae68e-e993-4616-8dbf-97f9823a9a26 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:49.846533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae68e-e993-4616-8dbf-97f9823a9a26 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:49.846756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae68e-e993-4616-8dbf-97f9823a9a26 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:49.848119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 696/1392] 10.222.0.42 () {54 vars in 967 bytes} [Wed Aug 31 19:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:20:49.853139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005aa24-acc2-4a57-b4ea-f6edfad3f0ae None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:49.853427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005aa24-acc2-4a57-b4ea-f6edfad3f0ae None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:49.853722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005aa24-acc2-4a57-b4ea-f6edfad3f0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:49.882971 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 697/1393] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:49.942450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-0005aa24-acc2-4a57-b4ea-f6edfad3f0ae None None] MFA Rules not processed for user `f14e5614aee44c59a47b12e5b35ea3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:49.943642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0005aa24-acc2-4a57-b4ea-f6edfad3f0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:50.043808 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 697/1394] 10.222.0.42 () {58 vars in 1064 bytes} [Wed Aug 31 19:20:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:50.051583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790dd72-f78a-4936-aeee-7008caa17df8 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:50.052960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2790dd72-f78a-4936-aeee-7008caa17df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:50.166723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790dd72-f78a-4936-aeee-7008caa17df8 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:50.176804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:50.181582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005aa24-acc2-4a57-b4ea-f6edfad3f0ae None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:50.183003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0005aa24-acc2-4a57-b4ea-f6edfad3f0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:50.220032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:50.256513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96f528-d3b5-48ff-93b1-ef9d3e27f338 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f14e5614aee44c59a47b12e5b35ea3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:50.257144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96f528-d3b5-48ff-93b1-ef9d3e27f338 service glance] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:50.257430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96f528-d3b5-48ff-93b1-ef9d3e27f338 service glance] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:50.257733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96f528-d3b5-48ff-93b1-ef9d3e27f338 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:50.259540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2a96f528-d3b5-48ff-93b1-ef9d3e27f338 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:50.345189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005aa24-acc2-4a57-b4ea-f6edfad3f0ae None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:50.418705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96f528-d3b5-48ff-93b1-ef9d3e27f338 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:50.420182 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96f528-d3b5-48ff-93b1-ef9d3e27f338 service glance] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:50.449441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 698/1395] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:20:50.475302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa68a4-a7e8-4396-907e-bbcc27665d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:50.475984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa68a4-a7e8-4396-907e-bbcc27665d7a service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:50.476144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa68a4-a7e8-4396-907e-bbcc27665d7a service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:50.476422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa68a4-a7e8-4396-907e-bbcc27665d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:50.478131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-bffa68a4-a7e8-4396-907e-bbcc27665d7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:50.499112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:50.592123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa68a4-a7e8-4396-907e-bbcc27665d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:50.594263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa68a4-a7e8-4396-907e-bbcc27665d7a service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:50.616591 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 698/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:20:51.441413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2574bd-ecc3-4b45-9d4d-8424609325d4 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:51.442288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2574bd-ecc3-4b45-9d4d-8424609325d4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:51.442573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2574bd-ecc3-4b45-9d4d-8424609325d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:51.492136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:51.517595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9d2574bd-ecc3-4b45-9d4d-8424609325d4 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:51.518835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9d2574bd-ecc3-4b45-9d4d-8424609325d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:51.607597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 699/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:51.655051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd22f-717b-4be4-beb6-dd6f37d97e17 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:51.655612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd22f-717b-4be4-beb6-dd6f37d97e17 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:51.655770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd22f-717b-4be4-beb6-dd6f37d97e17 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:51.657311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 699/1398] 10.222.0.42 () {54 vars in 943 bytes} [Wed Aug 31 19:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:51.664857 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958019-db64-43cf-bb10-3348c368cdff None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:51.665218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958019-db64-43cf-bb10-3348c368cdff None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:51.665566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958019-db64-43cf-bb10-3348c368cdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:51.745875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-cf958019-db64-43cf-bb10-3348c368cdff None None] MFA Rules not processed for user `78c331b659da48549c4c91e659ff83ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:51.747003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-cf958019-db64-43cf-bb10-3348c368cdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:51.819020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:51.872311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 700/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Wed Aug 31 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:51.883883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fd22f-717b-4be4-beb6-dd6f37d97e17 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:51.885538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f06fd22f-717b-4be4-beb6-dd6f37d97e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:52.041500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fd22f-717b-4be4-beb6-dd6f37d97e17 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:52.051952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:52.168290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30505aa-1780-4930-9dc0-41d0b3b547f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:52.168923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30505aa-1780-4930-9dc0-41d0b3b547f0 service swift] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:52.169208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30505aa-1780-4930-9dc0-41d0b3b547f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:52.169485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30505aa-1780-4930-9dc0-41d0b3b547f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:52.171913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f30505aa-1780-4930-9dc0-41d0b3b547f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:52.268399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30505aa-1780-4930-9dc0-41d0b3b547f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:52.270072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30505aa-1780-4930-9dc0-41d0b3b547f0 service swift] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:52.279932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 700/1400] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:20:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:20:52.790326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e61f2-8775-4941-afb8-0328abb10f07 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:52.790850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e61f2-8775-4941-afb8-0328abb10f07 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:52.790956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e61f2-8775-4941-afb8-0328abb10f07 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:52.792398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 701/1401] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:52.797832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea10359-1d37-4891-a2c4-d69806c3137b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:52.798307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea10359-1d37-4891-a2c4-d69806c3137b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:52.798398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea10359-1d37-4891-a2c4-d69806c3137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:52.853321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:52.872443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-aea10359-1d37-4891-a2c4-d69806c3137b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:52.875050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-aea10359-1d37-4891-a2c4-d69806c3137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:53.005851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 701/1402] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:53.291582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e61f2-8775-4941-afb8-0328abb10f07 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:53.291986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7f2e61f2-8775-4941-afb8-0328abb10f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:53.471430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e61f2-8775-4941-afb8-0328abb10f07 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:53.544184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:53.664145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c4afb-0789-4cf4-9e28-bc5c1f6b25b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:53.664832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4afb-0789-4cf4-9e28-bc5c1f6b25b5 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:53.665146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4afb-0789-4cf4-9e28-bc5c1f6b25b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:53.665423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4afb-0789-4cf4-9e28-bc5c1f6b25b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:53.667287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-043c4afb-0789-4cf4-9e28-bc5c1f6b25b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:53.783851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c4afb-0789-4cf4-9e28-bc5c1f6b25b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:53.786056 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c4afb-0789-4cf4-9e28-bc5c1f6b25b5 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:53.810658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 702/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:56.665301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a284135-5142-4303-b7c5-54da37318cb6 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:56.665904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a284135-5142-4303-b7c5-54da37318cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:56.665904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a284135-5142-4303-b7c5-54da37318cb6 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:56.667334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 702/1404] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:20:56.673188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d6444-d9f7-4acd-a08d-bae3ab7685cc None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:56.673630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d6444-d9f7-4acd-a08d-bae3ab7685cc None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:56.673844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d6444-d9f7-4acd-a08d-bae3ab7685cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:56.742201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:56.751551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e85d6444-d9f7-4acd-a08d-bae3ab7685cc None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:56.760336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e85d6444-d9f7-4acd-a08d-bae3ab7685cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:56.869721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 703/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:57.174920 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a284135-5142-4303-b7c5-54da37318cb6 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:57.176497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7a284135-5142-4303-b7c5-54da37318cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:57.318099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:57.356581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a284135-5142-4303-b7c5-54da37318cb6 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:57.480975 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94c5ea-d0d0-4cbc-9253-f54e2440e1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:57.481580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94c5ea-d0d0-4cbc-9253-f54e2440e1ae service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:57.481885 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94c5ea-d0d0-4cbc-9253-f54e2440e1ae service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:57.482163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94c5ea-d0d0-4cbc-9253-f54e2440e1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:57.483929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ee94c5ea-d0d0-4cbc-9253-f54e2440e1ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:57.579035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:57.590088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94c5ea-d0d0-4cbc-9253-f54e2440e1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:57.591760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94c5ea-d0d0-4cbc-9253-f54e2440e1ae service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:57.613232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 703/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:59.709405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901e00a-ae6f-4bde-82ae-4cc9356ee519 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:59.710154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901e00a-ae6f-4bde-82ae-4cc9356ee519 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:59.710154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901e00a-ae6f-4bde-82ae-4cc9356ee519 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:59.711389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 704/1407] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:20:59.717331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef593c35-c978-4930-ba43-d007a0463ce9 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:59.718533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef593c35-c978-4930-ba43-d007a0463ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:59.718739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef593c35-c978-4930-ba43-d007a0463ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:59.825848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ef593c35-c978-4930-ba43-d007a0463ce9 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:59.831313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ef593c35-c978-4930-ba43-d007a0463ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:59.944727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 704/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:00.230685 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901e00a-ae6f-4bde-82ae-4cc9356ee519 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:00.232398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1901e00a-ae6f-4bde-82ae-4cc9356ee519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:00.370166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:00.398882 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901e00a-ae6f-4bde-82ae-4cc9356ee519 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:00.529273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2895ce-a315-4ca2-baa4-ead084e91290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:00.529823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2895ce-a315-4ca2-baa4-ead084e91290 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:00.530103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2895ce-a315-4ca2-baa4-ead084e91290 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:00.530528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2895ce-a315-4ca2-baa4-ead084e91290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:00.532150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-be2895ce-a315-4ca2-baa4-ead084e91290 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:00.634105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:00.637988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2895ce-a315-4ca2-baa4-ead084e91290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:00.639782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2895ce-a315-4ca2-baa4-ead084e91290 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:00.659634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 705/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:09.942474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=74 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:10.701439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=7 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:15.814217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87970a9-3781-4b69-bd2d-fd531342cd4c None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:15.815297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87970a9-3781-4b69-bd2d-fd531342cd4c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:15.815297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87970a9-3781-4b69-bd2d-fd531342cd4c None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:15.816692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 705/1410] 10.222.0.42 () {54 vars in 918 bytes} [Wed Aug 31 19:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:15.823175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839b7a-e7fa-4cb0-8286-4cc9dfe53d52 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:15.823646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839b7a-e7fa-4cb0-8286-4cc9dfe53d52 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:15.823855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839b7a-e7fa-4cb0-8286-4cc9dfe53d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:15.907526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ff839b7a-e7fa-4cb0-8286-4cc9dfe53d52 None None] MFA Rules not processed for user `b98cb3da3efe49acbfe640366bf7b53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:15.908759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ff839b7a-e7fa-4cb0-8286-4cc9dfe53d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:16.021183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 706/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 31 19:21:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:16.036302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae84b9-7194-48b9-a750-f2fb48d7ea5b None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:16.036582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae84b9-7194-48b9-a750-f2fb48d7ea5b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:16.036858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae84b9-7194-48b9-a750-f2fb48d7ea5b None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:16.038251 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 706/1412] 10.222.0.42 () {54 vars in 918 bytes} [Wed Aug 31 19:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:16.043505 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489b1c-4178-4f1b-8151-7b8f7dabd110 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:16.043788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489b1c-4178-4f1b-8151-7b8f7dabd110 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:16.044060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489b1c-4178-4f1b-8151-7b8f7dabd110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:16.128548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:16.132414 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-7a489b1c-4178-4f1b-8151-7b8f7dabd110 None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:16.133636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7a489b1c-4178-4f1b-8151-7b8f7dabd110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:16.258438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 707/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 31 19:21:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:18.695594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a0034-6979-4c9c-91d8-077cada056bc None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:18.696182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a0034-6979-4c9c-91d8-077cada056bc None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:18.696182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a0034-6979-4c9c-91d8-077cada056bc None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:18.697623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:18.704402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c5121-08c9-4d37-8501-74fd1b0fd885 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:18.705012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c5121-08c9-4d37-8501-74fd1b0fd885 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:18.705012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c5121-08c9-4d37-8501-74fd1b0fd885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:18.781244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-6f1c5121-08c9-4d37-8501-74fd1b0fd885 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:18.783139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6f1c5121-08c9-4d37-8501-74fd1b0fd885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:18.838913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:18.882727 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:19.175660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a0034-6979-4c9c-91d8-077cada056bc None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:19.177194 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fd4a0034-6979-4c9c-91d8-077cada056bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:19.332450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a0034-6979-4c9c-91d8-077cada056bc None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:19.407213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:19.453163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03fd24-7828-419e-b6c1-7772f672a907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:19.453819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03fd24-7828-419e-b6c1-7772f672a907 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:19.456439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03fd24-7828-419e-b6c1-7772f672a907 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:19.456735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03fd24-7828-419e-b6c1-7772f672a907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:19.458450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9a03fd24-7828-419e-b6c1-7772f672a907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:19.552273 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03fd24-7828-419e-b6c1-7772f672a907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:19.553919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03fd24-7828-419e-b6c1-7772f672a907 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:19.572805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 708/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:20.488329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d27daa-12ff-4037-a1fe-3133eded9304 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:20.488867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d27daa-12ff-4037-a1fe-3133eded9304 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:20.488867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d27daa-12ff-4037-a1fe-3133eded9304 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:20.490301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:20.495625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6d27a-9891-4088-87bc-cc942f3e1c5f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:20.496103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6d27a-9891-4088-87bc-cc942f3e1c5f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:20.496216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6d27a-9891-4088-87bc-cc942f3e1c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:20.574901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e6a6d27a-9891-4088-87bc-cc942f3e1c5f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:20.576124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e6a6d27a-9891-4088-87bc-cc942f3e1c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:20.604347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:20.677309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:20.830598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d27daa-12ff-4037-a1fe-3133eded9304 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:20.832254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a0d27daa-12ff-4037-a1fe-3133eded9304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:20.982456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d27daa-12ff-4037-a1fe-3133eded9304 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:21.024599 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:21.122784 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f399410-66bc-4f42-b795-76b91a0c3309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:21.123399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f399410-66bc-4f42-b795-76b91a0c3309 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:21.123681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f399410-66bc-4f42-b795-76b91a0c3309 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:21.123957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f399410-66bc-4f42-b795-76b91a0c3309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:21.126246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7f399410-66bc-4f42-b795-76b91a0c3309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:21.215528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f399410-66bc-4f42-b795-76b91a0c3309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:21.217165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f399410-66bc-4f42-b795-76b91a0c3309 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:21.235832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 710/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:22.140197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa91012-739f-4b37-af10-db4f353dc942 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:22.145174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa91012-739f-4b37-af10-db4f353dc942 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:22.145174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa91012-739f-4b37-af10-db4f353dc942 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:22.145174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:22.147883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421db72-2cc4-4bfd-863d-b4217a32863f None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:22.148363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421db72-2cc4-4bfd-863d-b4217a32863f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:22.148529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421db72-2cc4-4bfd-863d-b4217a32863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:22.209528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:22.232084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3421db72-2cc4-4bfd-863d-b4217a32863f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:22.233342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3421db72-2cc4-4bfd-863d-b4217a32863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:22.333283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:22.485323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa91012-739f-4b37-af10-db4f353dc942 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:22.486897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-afa91012-739f-4b37-af10-db4f353dc942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:22.634535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa91012-739f-4b37-af10-db4f353dc942 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:22.647250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:22.746619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e433ff-ce3e-459a-8aa4-89698894e43a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:22.747231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e433ff-ce3e-459a-8aa4-89698894e43a service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:22.747507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e433ff-ce3e-459a-8aa4-89698894e43a service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:22.747774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e433ff-ce3e-459a-8aa4-89698894e43a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:22.749370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a2e433ff-ce3e-459a-8aa4-89698894e43a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:22.847063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e433ff-ce3e-459a-8aa4-89698894e43a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:22.848684 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e433ff-ce3e-459a-8aa4-89698894e43a service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:22.867443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 711/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:23.739890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5453-a967-4cff-b8c7-99846175576c None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:23.740448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5453-a967-4cff-b8c7-99846175576c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:23.740448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5453-a967-4cff-b8c7-99846175576c None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:23.741841 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:23.746819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74406265-1fff-424f-9b8f-08b067f8930c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:23.747200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74406265-1fff-424f-9b8f-08b067f8930c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:23.747374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74406265-1fff-424f-9b8f-08b067f8930c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:23.768186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:23.824775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-74406265-1fff-424f-9b8f-08b067f8930c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:23.826026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-74406265-1fff-424f-9b8f-08b067f8930c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:23.921304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:24.071954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d5453-a967-4cff-b8c7-99846175576c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:24.073806 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1f9d5453-a967-4cff-b8c7-99846175576c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:24.184105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:24.220208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d5453-a967-4cff-b8c7-99846175576c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:24.331561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4950a-0f20-4412-9f7d-4b72034c81a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:24.332161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4950a-0f20-4412-9f7d-4b72034c81a1 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:24.332441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4950a-0f20-4412-9f7d-4b72034c81a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:24.332710 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4950a-0f20-4412-9f7d-4b72034c81a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:24.334316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3ee4950a-0f20-4412-9f7d-4b72034c81a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:24.409374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:24.422950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4950a-0f20-4412-9f7d-4b72034c81a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:24.424552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4950a-0f20-4412-9f7d-4b72034c81a1 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:24.442907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 713/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:25.317824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9bdd2-80f2-4618-bdef-97411c460a09 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:25.318390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9bdd2-80f2-4618-bdef-97411c460a09 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:25.318390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9bdd2-80f2-4618-bdef-97411c460a09 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:25.319754 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:25.324621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3c8e-bf07-48f4-b949-f5310a70d308 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:25.324998 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3c8e-bf07-48f4-b949-f5310a70d308 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:25.325184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3c8e-bf07-48f4-b949-f5310a70d308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:25.401404 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a46b3c8e-bf07-48f4-b949-f5310a70d308 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:25.402654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a46b3c8e-bf07-48f4-b949-f5310a70d308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:25.498415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:25.654686 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9bdd2-80f2-4618-bdef-97411c460a09 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:25.656333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-28e9bdd2-80f2-4618-bdef-97411c460a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:25.744237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:25.808643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9bdd2-80f2-4618-bdef-97411c460a09 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:25.926687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fcaa3-1e2e-49f5-ab32-28ad000685a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:25.927290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fcaa3-1e2e-49f5-ab32-28ad000685a6 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:25.927565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fcaa3-1e2e-49f5-ab32-28ad000685a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:25.927836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fcaa3-1e2e-49f5-ab32-28ad000685a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:25.929489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-be6fcaa3-1e2e-49f5-ab32-28ad000685a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:25.978613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:26.019949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fcaa3-1e2e-49f5-ab32-28ad000685a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:26.021590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fcaa3-1e2e-49f5-ab32-28ad000685a6 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:26.039475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 714/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:26.924478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a5bbb-9256-4a12-94e3-de0c7b561e4f None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:26.925020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a5bbb-9256-4a12-94e3-de0c7b561e4f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:26.925020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a5bbb-9256-4a12-94e3-de0c7b561e4f None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:26.926415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:26.931696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c2c2c-ba64-4ada-a749-1ff17feb4acc None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:26.932237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c2c2c-ba64-4ada-a749-1ff17feb4acc None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:26.932237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c2c2c-ba64-4ada-a749-1ff17feb4acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:27.011618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-714c2c2c-ba64-4ada-a749-1ff17feb4acc None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:27.012832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-714c2c2c-ba64-4ada-a749-1ff17feb4acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:27.116519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:27.269367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a5bbb-9256-4a12-94e3-de0c7b561e4f None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:27.270933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a98a5bbb-9256-4a12-94e3-de0c7b561e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:27.319602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:27.416199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a5bbb-9256-4a12-94e3-de0c7b561e4f None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:27.526384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e23d6-bd7d-4219-a22f-b8a8df6b611a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:27.526734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e23d6-bd7d-4219-a22f-b8a8df6b611a service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:27.527015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e23d6-bd7d-4219-a22f-b8a8df6b611a service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:27.527288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e23d6-bd7d-4219-a22f-b8a8df6b611a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:27.528892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bf7e23d6-bd7d-4219-a22f-b8a8df6b611a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:27.536699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:27.742196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e23d6-bd7d-4219-a22f-b8a8df6b611a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:27.743840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e23d6-bd7d-4219-a22f-b8a8df6b611a service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:27.762525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 716/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:28.672020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00a713-6c12-4fdd-bc13-32eba36c8243 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:28.672577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00a713-6c12-4fdd-bc13-32eba36c8243 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:28.672729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00a713-6c12-4fdd-bc13-32eba36c8243 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:28.674183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:28.679475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef72ae-a641-4b4a-8bc8-6f0408c4b8a6 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:28.679941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef72ae-a641-4b4a-8bc8-6f0408c4b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:28.680044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef72ae-a641-4b4a-8bc8-6f0408c4b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:28.755756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-bbef72ae-a641-4b4a-8bc8-6f0408c4b8a6 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:28.756980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bbef72ae-a641-4b4a-8bc8-6f0408c4b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:28.826908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:28.856167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:29.005277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00a713-6c12-4fdd-bc13-32eba36c8243 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:29.006827 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0f00a713-6c12-4fdd-bc13-32eba36c8243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:29.024552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:29.164764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00a713-6c12-4fdd-bc13-32eba36c8243 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:29.288846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:29.336099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7745e-ea2b-4a0e-be3e-2cc2bc1bb514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:29.337114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7745e-ea2b-4a0e-be3e-2cc2bc1bb514 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:29.337613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7745e-ea2b-4a0e-be3e-2cc2bc1bb514 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:29.338141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7745e-ea2b-4a0e-be3e-2cc2bc1bb514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:29.341267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0eb7745e-ea2b-4a0e-be3e-2cc2bc1bb514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:29.456287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7745e-ea2b-4a0e-be3e-2cc2bc1bb514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:29.457917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7745e-ea2b-4a0e-be3e-2cc2bc1bb514 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:29.476671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 717/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:30.375804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f23e8-2cbf-4b94-bcc4-5bd256eb7496 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:30.375804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f23e8-2cbf-4b94-bcc4-5bd256eb7496 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:30.375804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f23e8-2cbf-4b94-bcc4-5bd256eb7496 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:30.377233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:30.382668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba56a7d-ffa4-48e8-a4b1-bb495ac8a908 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:30.383256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba56a7d-ffa4-48e8-a4b1-bb495ac8a908 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:30.383256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba56a7d-ffa4-48e8-a4b1-bb495ac8a908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:30.459996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9ba56a7d-ffa4-48e8-a4b1-bb495ac8a908 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:30.461201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9ba56a7d-ffa4-48e8-a4b1-bb495ac8a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:30.514745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:30.573528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:30.725241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f23e8-2cbf-4b94-bcc4-5bd256eb7496 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:30.726842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-122f23e8-2cbf-4b94-bcc4-5bd256eb7496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:30.869689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f23e8-2cbf-4b94-bcc4-5bd256eb7496 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:30.923850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:30.982817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b916f-de40-4e30-ad66-fe1774a47831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:30.983334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b916f-de40-4e30-ad66-fe1774a47831 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:30.983608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b916f-de40-4e30-ad66-fe1774a47831 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:30.983877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b916f-de40-4e30-ad66-fe1774a47831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:30.985450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-542b916f-de40-4e30-ad66-fe1774a47831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:31.072019 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b916f-de40-4e30-ad66-fe1774a47831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:31.073592 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b916f-de40-4e30-ad66-fe1774a47831 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:31.091779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 719/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:31.958381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f86c0-c3b7-4dd5-8159-048cc6e8478d None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:31.958959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f86c0-c3b7-4dd5-8159-048cc6e8478d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:31.958959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f86c0-c3b7-4dd5-8159-048cc6e8478d None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:31.960303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:31.965350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde643a-96a6-409f-ae88-a9a5d516a6c5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:31.965796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde643a-96a6-409f-ae88-a9a5d516a6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:31.965967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde643a-96a6-409f-ae88-a9a5d516a6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:32.039790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-bfde643a-96a6-409f-ae88-a9a5d516a6c5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:32.040994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bfde643a-96a6-409f-ae88-a9a5d516a6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:32.043104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:32.138265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:32.298673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f86c0-c3b7-4dd5-8159-048cc6e8478d None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:32.300209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6d0f86c0-c3b7-4dd5-8159-048cc6e8478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:32.447757 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f86c0-c3b7-4dd5-8159-048cc6e8478d None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:32.475872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:32.566315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70507c8d-245a-433b-bbb9-cee1b40040d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:32.567840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70507c8d-245a-433b-bbb9-cee1b40040d2 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:32.567840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70507c8d-245a-433b-bbb9-cee1b40040d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:32.567840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70507c8d-245a-433b-bbb9-cee1b40040d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:32.569076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-70507c8d-245a-433b-bbb9-cee1b40040d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:32.661555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70507c8d-245a-433b-bbb9-cee1b40040d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:32.663162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70507c8d-245a-433b-bbb9-cee1b40040d2 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:32.681968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 720/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:34.536137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae4df-5363-4972-9f40-577625ccd01d None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:34.536671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae4df-5363-4972-9f40-577625ccd01d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:34.536671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae4df-5363-4972-9f40-577625ccd01d None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:34.538065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:34.543604 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6fb39-f373-419a-a493-3b8b52c9e9fb None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:34.544096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6fb39-f373-419a-a493-3b8b52c9e9fb None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:34.544194 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6fb39-f373-419a-a493-3b8b52c9e9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:34.588303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:34.615384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-31c6fb39-f373-419a-a493-3b8b52c9e9fb None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:34.616609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-31c6fb39-f373-419a-a493-3b8b52c9e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:34.718385 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:35.012339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dae4df-5363-4972-9f40-577625ccd01d None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:35.013900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-09dae4df-5363-4972-9f40-577625ccd01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:35.122869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dae4df-5363-4972-9f40-577625ccd01d None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:35.157690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:35.202931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700852d-5b3b-4c42-927c-973da3597383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:35.203866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700852d-5b3b-4c42-927c-973da3597383 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:35.204238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700852d-5b3b-4c42-927c-973da3597383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:35.204705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700852d-5b3b-4c42-927c-973da3597383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:35.206713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c700852d-5b3b-4c42-927c-973da3597383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:35.317813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700852d-5b3b-4c42-927c-973da3597383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:35.319175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700852d-5b3b-4c42-927c-973da3597383 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:35.337238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 722/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:37.441349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8bfb8-3b5a-46ce-8ce1-0ab33124cd91 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:37.442031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8bfb8-3b5a-46ce-8ce1-0ab33124cd91 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:37.442031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8bfb8-3b5a-46ce-8ce1-0ab33124cd91 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:37.443293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:37.456490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b838612-8f2c-448c-bd30-829a419b4c1c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:37.456999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b838612-8f2c-448c-bd30-829a419b4c1c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:37.457104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b838612-8f2c-448c-bd30-829a419b4c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:37.524052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-1b838612-8f2c-448c-bd30-829a419b4c1c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:37.525262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1b838612-8f2c-448c-bd30-829a419b4c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:37.539000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:37.625014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:37.910080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8bfb8-3b5a-46ce-8ce1-0ab33124cd91 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:37.911640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-03b8bfb8-3b5a-46ce-8ce1-0ab33124cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:38.017353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8bfb8-3b5a-46ce-8ce1-0ab33124cd91 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:38.029577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:38.091889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c51d2-25da-40be-b100-24edfd2a9042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:38.092397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c51d2-25da-40be-b100-24edfd2a9042 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:38.092675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c51d2-25da-40be-b100-24edfd2a9042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:38.092948 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c51d2-25da-40be-b100-24edfd2a9042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:38.094599 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9e0c51d2-25da-40be-b100-24edfd2a9042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:38.204216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c51d2-25da-40be-b100-24edfd2a9042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:38.205659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c51d2-25da-40be-b100-24edfd2a9042 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:38.225402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 723/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:40.536099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea7b3-7856-4374-8e1b-1ec6a0152f98 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:40.536632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea7b3-7856-4374-8e1b-1ec6a0152f98 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:40.536753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea7b3-7856-4374-8e1b-1ec6a0152f98 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:40.538076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:40.543576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae2ba-4fdb-4170-8b8c-039477a8fcc0 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:40.544027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae2ba-4fdb-4170-8b8c-039477a8fcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:40.544122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ae2ba-4fdb-4170-8b8c-039477a8fcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:40.594766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:40.614559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-3b7ae2ba-4fdb-4170-8b8c-039477a8fcc0 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:40.615782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3b7ae2ba-4fdb-4170-8b8c-039477a8fcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:40.712753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:40.998325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ea7b3-7856-4374-8e1b-1ec6a0152f98 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:40.999951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d48ea7b3-7856-4374-8e1b-1ec6a0152f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:41.104531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ea7b3-7856-4374-8e1b-1ec6a0152f98 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:41.146588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:41.180253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e12b87-52df-4a36-87b8-56737ab00b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:41.180868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e12b87-52df-4a36-87b8-56737ab00b85 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:41.181343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e12b87-52df-4a36-87b8-56737ab00b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:41.181832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e12b87-52df-4a36-87b8-56737ab00b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:41.183789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c3e12b87-52df-4a36-87b8-56737ab00b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:41.293137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e12b87-52df-4a36-87b8-56737ab00b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:41.294537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e12b87-52df-4a36-87b8-56737ab00b85 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:41.313791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 725/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:43.398942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90975af3-84cd-4c73-89d7-360c2fbc962a None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:43.399511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90975af3-84cd-4c73-89d7-360c2fbc962a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:43.399511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90975af3-84cd-4c73-89d7-360c2fbc962a None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:43.400861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:43.406966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea2ac7-3c5f-4128-98dc-60b06e3ef941 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:43.407449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea2ac7-3c5f-4128-98dc-60b06e3ef941 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:43.407564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea2ac7-3c5f-4128-98dc-60b06e3ef941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:43.477754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-afea2ac7-3c5f-4128-98dc-60b06e3ef941 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:43.478995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-afea2ac7-3c5f-4128-98dc-60b06e3ef941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:43.502500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:43.582492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:43.871730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90975af3-84cd-4c73-89d7-360c2fbc962a None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:43.873298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-90975af3-84cd-4c73-89d7-360c2fbc962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:43.987222 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90975af3-84cd-4c73-89d7-360c2fbc962a None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:44.008834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:44.070612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc9e82-acf5-4597-8108-1d27c12191ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:44.071231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc9e82-acf5-4597-8108-1d27c12191ab service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:44.071509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc9e82-acf5-4597-8108-1d27c12191ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:44.071785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc9e82-acf5-4597-8108-1d27c12191ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:44.073456 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-55cc9e82-acf5-4597-8108-1d27c12191ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:44.189294 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc9e82-acf5-4597-8108-1d27c12191ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:44.190796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc9e82-acf5-4597-8108-1d27c12191ab service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:44.210194 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 726/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:46.263034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fc43e-85da-4233-b642-a259798ba24c None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.263672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fc43e-85da-4233-b642-a259798ba24c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.263672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fc43e-85da-4233-b642-a259798ba24c None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.264947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:46.270698 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73094-8c2b-4824-947b-29c7d564042c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.271202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73094-8c2b-4824-947b-29c7d564042c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.271721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73094-8c2b-4824-947b-29c7d564042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.345900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:46.349128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-fbc73094-8c2b-4824-947b-29c7d564042c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:46.350465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fbc73094-8c2b-4824-947b-29c7d564042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:46.466650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:46.751323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fc43e-85da-4233-b642-a259798ba24c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:46.752888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2c9fc43e-85da-4233-b642-a259798ba24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:46.867762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fc43e-85da-4233-b642-a259798ba24c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:46.922504 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:46.948676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33577cb-164c-4581-bbbd-9d9084da597d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:46.949293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33577cb-164c-4581-bbbd-9d9084da597d service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.949573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33577cb-164c-4581-bbbd-9d9084da597d service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.949884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33577cb-164c-4581-bbbd-9d9084da597d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.951508 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a33577cb-164c-4581-bbbd-9d9084da597d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:47.073085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33577cb-164c-4581-bbbd-9d9084da597d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:47.074468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33577cb-164c-4581-bbbd-9d9084da597d service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:47.093401 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 728/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:49.088362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164b7ef-c5aa-494f-aefe-11cd6427f084 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:49.088891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164b7ef-c5aa-494f-aefe-11cd6427f084 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:49.088891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164b7ef-c5aa-494f-aefe-11cd6427f084 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:49.090214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:49.096342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5ab7-52c3-47ef-b2d7-104f5f0b2a06 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:49.096818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5ab7-52c3-47ef-b2d7-104f5f0b2a06 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:49.096968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5ab7-52c3-47ef-b2d7-104f5f0b2a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:49.173606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-857d5ab7-52c3-47ef-b2d7-104f5f0b2a06 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:49.174864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-857d5ab7-52c3-47ef-b2d7-104f5f0b2a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:49.206087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:49.274673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:49.563256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164b7ef-c5aa-494f-aefe-11cd6427f084 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:49.565032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d164b7ef-c5aa-494f-aefe-11cd6427f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:49.674668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164b7ef-c5aa-494f-aefe-11cd6427f084 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:49.705328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:49.753629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b478c-86b2-4db0-ba6b-90c30f8a32e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:49.754266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b478c-86b2-4db0-ba6b-90c30f8a32e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:49.754542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b478c-86b2-4db0-ba6b-90c30f8a32e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:49.754813 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b478c-86b2-4db0-ba6b-90c30f8a32e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:49.756471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-772b478c-86b2-4db0-ba6b-90c30f8a32e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:49.876503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b478c-86b2-4db0-ba6b-90c30f8a32e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:49.877988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b478c-86b2-4db0-ba6b-90c30f8a32e1 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:49.898200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 729/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:51.927494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e6a29-68e1-465a-bc4f-66dc507d35a1 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:51.928129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e6a29-68e1-465a-bc4f-66dc507d35a1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:51.928416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e6a29-68e1-465a-bc4f-66dc507d35a1 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:51.930617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:51.936430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49424-c428-4617-841b-72e810f10e61 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:51.936908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49424-c428-4617-841b-72e810f10e61 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:51.937091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49424-c428-4617-841b-72e810f10e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:52.020308 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-a5a49424-c428-4617-841b-72e810f10e61 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:52.022422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a5a49424-c428-4617-841b-72e810f10e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:52.037876 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:52.160819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:52.457598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e6a29-68e1-465a-bc4f-66dc507d35a1 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:52.459166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d82e6a29-68e1-465a-bc4f-66dc507d35a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:52.576228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e6a29-68e1-465a-bc4f-66dc507d35a1 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:52.645806 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:52.666924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c6f55-e9f9-419e-80cb-e636c1469940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:52.667535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c6f55-e9f9-419e-80cb-e636c1469940 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:52.667819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c6f55-e9f9-419e-80cb-e636c1469940 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:52.668089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c6f55-e9f9-419e-80cb-e636c1469940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:52.669802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8a5c6f55-e9f9-419e-80cb-e636c1469940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:52.785202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c6f55-e9f9-419e-80cb-e636c1469940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:52.786624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c6f55-e9f9-419e-80cb-e636c1469940 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:52.806545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 731/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:54.838154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3460cf-8035-4002-aa25-3311c1a89b3d None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:54.838696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3460cf-8035-4002-aa25-3311c1a89b3d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:54.838696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3460cf-8035-4002-aa25-3311c1a89b3d None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:54.840137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:54.846077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533131f4-d211-4364-84fb-1335c6ea1f63 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:54.846652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533131f4-d211-4364-84fb-1335c6ea1f63 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:54.846758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533131f4-d211-4364-84fb-1335c6ea1f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:54.922618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-533131f4-d211-4364-84fb-1335c6ea1f63 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:54.923879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-533131f4-d211-4364-84fb-1335c6ea1f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:54.966989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:55.032970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:55.322981 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3460cf-8035-4002-aa25-3311c1a89b3d None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:55.324592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6c3460cf-8035-4002-aa25-3311c1a89b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:55.432735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3460cf-8035-4002-aa25-3311c1a89b3d None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:55.474974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:55.511529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db94a8e-373c-4f96-8e6b-8c8d1ffa71e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:55.512155 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db94a8e-373c-4f96-8e6b-8c8d1ffa71e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:55.512421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db94a8e-373c-4f96-8e6b-8c8d1ffa71e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:55.512688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db94a8e-373c-4f96-8e6b-8c8d1ffa71e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:55.514457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8db94a8e-373c-4f96-8e6b-8c8d1ffa71e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:55.630615 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db94a8e-373c-4f96-8e6b-8c8d1ffa71e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:55.632050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db94a8e-373c-4f96-8e6b-8c8d1ffa71e8 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:55.651187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 732/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:21:57.616475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac559e-dcc8-4e91-89d8-da83dfa34340 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:57.617073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac559e-dcc8-4e91-89d8-da83dfa34340 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:57.617073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac559e-dcc8-4e91-89d8-da83dfa34340 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:57.618454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:21:57.623903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d722b9-e560-4e8e-86fc-3c35295e35d6 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:57.624388 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d722b9-e560-4e8e-86fc-3c35295e35d6 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:57.625066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d722b9-e560-4e8e-86fc-3c35295e35d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:57.701797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e9d722b9-e560-4e8e-86fc-3c35295e35d6 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:57.703333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e9d722b9-e560-4e8e-86fc-3c35295e35d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:57.723501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:57.806815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:58.089967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac559e-dcc8-4e91-89d8-da83dfa34340 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:58.092652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-32ac559e-dcc8-4e91-89d8-da83dfa34340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:58.224523 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac559e-dcc8-4e91-89d8-da83dfa34340 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:58.297166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:58.303887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac49db2-6847-41e3-a22f-e35e2ad71e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:58.304507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49db2-6847-41e3-a22f-e35e2ad71e44 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:58.304791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49db2-6847-41e3-a22f-e35e2ad71e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:58.305072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49db2-6847-41e3-a22f-e35e2ad71e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:58.306873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-dac49db2-6847-41e3-a22f-e35e2ad71e44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:58.432242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac49db2-6847-41e3-a22f-e35e2ad71e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:58.433923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac49db2-6847-41e3-a22f-e35e2ad71e44 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:58.455351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 734/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:00.412892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaf10b-97b8-4cce-bd41-df79d89a4b83 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:00.413497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaf10b-97b8-4cce-bd41-df79d89a4b83 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:00.413497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaf10b-97b8-4cce-bd41-df79d89a4b83 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:00.414829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:00.420224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fb4a5-8731-478d-8e0b-f347131dfc93 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:00.420662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fb4a5-8731-478d-8e0b-f347131dfc93 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:00.420766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fb4a5-8731-478d-8e0b-f347131dfc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:00.488482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-de3fb4a5-8731-478d-8e0b-f347131dfc93 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:00.489754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-de3fb4a5-8731-478d-8e0b-f347131dfc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:00.539013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:00.588642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:00.869879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eaf10b-97b8-4cce-bd41-df79d89a4b83 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:00.871470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-54eaf10b-97b8-4cce-bd41-df79d89a4b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:00.976151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eaf10b-97b8-4cce-bd41-df79d89a4b83 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:01.023203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:01.049045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168485c8-c015-4af6-8eeb-91124118b981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:01.049661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168485c8-c015-4af6-8eeb-91124118b981 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:01.049968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168485c8-c015-4af6-8eeb-91124118b981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:01.050237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168485c8-c015-4af6-8eeb-91124118b981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:01.051854 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-168485c8-c015-4af6-8eeb-91124118b981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:01.163531 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168485c8-c015-4af6-8eeb-91124118b981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:01.164873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168485c8-c015-4af6-8eeb-91124118b981 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:01.182647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 735/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:10.586797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=22 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:11.180422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=66 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:21.000800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf838e-c5f3-40a6-9253-aafbc59e293c None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:21.001349 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf838e-c5f3-40a6-9253-aafbc59e293c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:21.001349 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf838e-c5f3-40a6-9253-aafbc59e293c None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:21.002729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 736/1471] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:22:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:21.008347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406066dd-b6aa-4156-9052-e104106a4e67 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:21.008793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406066dd-b6aa-4156-9052-e104106a4e67 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:21.008902 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406066dd-b6aa-4156-9052-e104106a4e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:21.075202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-406066dd-b6aa-4156-9052-e104106a4e67 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:21.076340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-406066dd-b6aa-4156-9052-e104106a4e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:21.171416 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 736/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:21.474768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1fc0-7eb6-49c1-8662-f79d630c5359 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:21.480635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1fc0-7eb6-49c1-8662-f79d630c5359 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:21.480635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1fc0-7eb6-49c1-8662-f79d630c5359 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:21.480635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 737/1473] 10.222.0.42 () {54 vars in 967 bytes} [Wed Aug 31 19:22:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:21.484268 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38f294-1c92-45fd-a63e-3a74ea402c4d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:21.484562 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38f294-1c92-45fd-a63e-3a74ea402c4d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:21.484837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38f294-1c92-45fd-a63e-3a74ea402c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:21.696422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-2f38f294-1c92-45fd-a63e-3a74ea402c4d None None] MFA Rules not processed for user `f14e5614aee44c59a47b12e5b35ea3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:21.697693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2f38f294-1c92-45fd-a63e-3a74ea402c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:21.719972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:21.776661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 737/1474] 10.222.0.42 () {58 vars in 1064 bytes} [Wed Aug 31 19:22:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:21.784973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1fc0-7eb6-49c1-8662-f79d630c5359 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:21.786611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-12bf1fc0-7eb6-49c1-8662-f79d630c5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:21.886948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1fc0-7eb6-49c1-8662-f79d630c5359 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:21.959644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e377895-0fe8-42ed-87d3-8e8e1c3c2f2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f14e5614aee44c59a47b12e5b35ea3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:21.960162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e377895-0fe8-42ed-87d3-8e8e1c3c2f2d service glance] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:21.960437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e377895-0fe8-42ed-87d3-8e8e1c3c2f2d service glance] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:21.960706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e377895-0fe8-42ed-87d3-8e8e1c3c2f2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:21.962315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8e377895-0fe8-42ed-87d3-8e8e1c3c2f2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:22.016570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:22.069929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e377895-0fe8-42ed-87d3-8e8e1c3c2f2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:22.071362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e377895-0fe8-42ed-87d3-8e8e1c3c2f2d service glance] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:22.089922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 738/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:24.138705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5775f-7e10-446c-ac39-a18abfd0ab97 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:24.139780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5775f-7e10-446c-ac39-a18abfd0ab97 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:24.139892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5775f-7e10-446c-ac39-a18abfd0ab97 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:24.141171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 738/1476] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:24.146386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252a3d6-02a4-421d-8ea0-60a9a0c04342 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:24.146794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252a3d6-02a4-421d-8ea0-60a9a0c04342 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:24.146931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252a3d6-02a4-421d-8ea0-60a9a0c04342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:24.212526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4252a3d6-02a4-421d-8ea0-60a9a0c04342 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:24.213758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4252a3d6-02a4-421d-8ea0-60a9a0c04342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:24.310010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 739/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:24.587392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5775f-7e10-446c-ac39-a18abfd0ab97 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:24.590062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-30e5775f-7e10-446c-ac39-a18abfd0ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:24.728929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5775f-7e10-446c-ac39-a18abfd0ab97 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:24.779903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:24.827984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e235bd-7306-48ae-b87d-52930258bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:24.828603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e235bd-7306-48ae-b87d-52930258bfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:24.828881 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e235bd-7306-48ae-b87d-52930258bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:24.829155 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e235bd-7306-48ae-b87d-52930258bfd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:24.829841 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e235bd-7306-48ae-b87d-52930258bfd5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:24.831619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WARNING py.warnings [None req-73e235bd-7306-48ae-b87d-52930258bfd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:22:24.831619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: warnings.warn(msg) Aug 31 19:22:24.831619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: Aug 31 19:22:24.832773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e235bd-7306-48ae-b87d-52930258bfd5 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:24.851904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 739/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 31 19:22:24 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:22:26.827052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a28386-0184-4e03-8feb-b68f85f637c3 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:26.827723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a28386-0184-4e03-8feb-b68f85f637c3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:26.827861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a28386-0184-4e03-8feb-b68f85f637c3 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:26.829235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 740/1479] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:26.834464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f2d08-fb16-48da-9158-db25fa214415 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:26.834916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f2d08-fb16-48da-9158-db25fa214415 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:26.835026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f2d08-fb16-48da-9158-db25fa214415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:26.900967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-988f2d08-fb16-48da-9158-db25fa214415 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:26.902202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-988f2d08-fb16-48da-9158-db25fa214415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:27.000528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 740/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:27.312913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a28386-0184-4e03-8feb-b68f85f637c3 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:27.314463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-66a28386-0184-4e03-8feb-b68f85f637c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:27.324163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:27.469290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a28386-0184-4e03-8feb-b68f85f637c3 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:27.553354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:27.589625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037156b5-c6e0-4914-8c06-534b73a334c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:27.590257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037156b5-c6e0-4914-8c06-534b73a334c9 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:27.590538 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037156b5-c6e0-4914-8c06-534b73a334c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:27.590807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037156b5-c6e0-4914-8c06-534b73a334c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:27.592423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-037156b5-c6e0-4914-8c06-534b73a334c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:27.681960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037156b5-c6e0-4914-8c06-534b73a334c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:27.683544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037156b5-c6e0-4914-8c06-534b73a334c9 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:27.701906 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 741/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:29.832494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d5fc-553e-4704-a747-09c8599a029f None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:29.833078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d5fc-553e-4704-a747-09c8599a029f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:29.833078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1d5fc-553e-4704-a747-09c8599a029f None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:29.834478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 741/1482] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:29.840024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224298-a972-424f-a3a1-44f8a2737dfc None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:29.840507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224298-a972-424f-a3a1-44f8a2737dfc None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:29.840614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224298-a972-424f-a3a1-44f8a2737dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:29.909296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-fc224298-a972-424f-a3a1-44f8a2737dfc None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:29.910546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-fc224298-a972-424f-a3a1-44f8a2737dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:29.960912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:30.013606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 742/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:30.312500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1d5fc-553e-4704-a747-09c8599a029f None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:30.314142 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-11a1d5fc-553e-4704-a747-09c8599a029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:30.339460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:30.424731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1d5fc-553e-4704-a747-09c8599a029f None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:30.503549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b0540-d646-477c-9c70-01fef501b761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:30.504154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b0540-d646-477c-9c70-01fef501b761 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:30.504431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b0540-d646-477c-9c70-01fef501b761 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:30.504703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b0540-d646-477c-9c70-01fef501b761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:30.506348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-263b0540-d646-477c-9c70-01fef501b761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:30.583383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:30.619661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b0540-d646-477c-9c70-01fef501b761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:30.621090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b0540-d646-477c-9c70-01fef501b761 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:30.639566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 742/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:32.628545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff7a9-3784-4ab9-a03a-18dd48e85419 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:32.629083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff7a9-3784-4ab9-a03a-18dd48e85419 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:32.629083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff7a9-3784-4ab9-a03a-18dd48e85419 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:32.630472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 743/1485] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:32.636284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6b4bb-53b4-4872-9199-4605bdf92ddc None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:32.636819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6b4bb-53b4-4872-9199-4605bdf92ddc None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:32.636924 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6b4bb-53b4-4872-9199-4605bdf92ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:32.707788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-7be6b4bb-53b4-4872-9199-4605bdf92ddc None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:32.709023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7be6b4bb-53b4-4872-9199-4605bdf92ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:32.808525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 743/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:33.098732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff7a9-3784-4ab9-a03a-18dd48e85419 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:33.100332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8d3ff7a9-3784-4ab9-a03a-18dd48e85419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:33.210296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff7a9-3784-4ab9-a03a-18dd48e85419 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:33.288943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:33.290765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a936f34-0363-4a6c-9dcb-9467ca13f64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:33.291385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a936f34-0363-4a6c-9dcb-9467ca13f64e service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:33.291669 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a936f34-0363-4a6c-9dcb-9467ca13f64e service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:33.291952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a936f34-0363-4a6c-9dcb-9467ca13f64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:33.293628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1a936f34-0363-4a6c-9dcb-9467ca13f64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:33.403465 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a936f34-0363-4a6c-9dcb-9467ca13f64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:33.404845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a936f34-0363-4a6c-9dcb-9467ca13f64e service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:33.423418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 744/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:35.443427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021005cd-2024-45fa-bcea-3f04fbd2f867 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:35.447541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021005cd-2024-45fa-bcea-3f04fbd2f867 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:35.447541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021005cd-2024-45fa-bcea-3f04fbd2f867 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:35.447541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 744/1488] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:35.450803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb10e7-5125-4838-8144-46c96a05bf72 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:35.451238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb10e7-5125-4838-8144-46c96a05bf72 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:35.451363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb10e7-5125-4838-8144-46c96a05bf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:35.522170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c2eb10e7-5125-4838-8144-46c96a05bf72 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:35.523414 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c2eb10e7-5125-4838-8144-46c96a05bf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:35.581905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:35.626264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 745/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:35.924626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021005cd-2024-45fa-bcea-3f04fbd2f867 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:35.926228 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-021005cd-2024-45fa-bcea-3f04fbd2f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:35.971657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:36.045924 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021005cd-2024-45fa-bcea-3f04fbd2f867 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:36.128633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0839238-e220-4498-a524-0d0cf86ded7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:36.129244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0839238-e220-4498-a524-0d0cf86ded7b service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:36.129527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0839238-e220-4498-a524-0d0cf86ded7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:36.129832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0839238-e220-4498-a524-0d0cf86ded7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:36.131471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a0839238-e220-4498-a524-0d0cf86ded7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:36.215292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:36.247769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0839238-e220-4498-a524-0d0cf86ded7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:36.250274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0839238-e220-4498-a524-0d0cf86ded7b service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:36.268995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 745/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:38.642415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147b07-4b47-4612-96be-f9c3d6cfc13d None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:38.643252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147b07-4b47-4612-96be-f9c3d6cfc13d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:38.643410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147b07-4b47-4612-96be-f9c3d6cfc13d None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:38.645071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 746/1491] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 31 19:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:22:38.651091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bdada-82cf-486d-83da-86c2badd66cf None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:38.651599 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bdada-82cf-486d-83da-86c2badd66cf None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:38.651693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bdada-82cf-486d-83da-86c2badd66cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:38.729463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-993bdada-82cf-486d-83da-86c2badd66cf None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:38.730663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-993bdada-82cf-486d-83da-86c2badd66cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:38.846995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 746/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 31 19:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:39.147233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f147b07-4b47-4612-96be-f9c3d6cfc13d None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:39.149022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0f147b07-4b47-4612-96be-f9c3d6cfc13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:39.259408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f147b07-4b47-4612-96be-f9c3d6cfc13d None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:39.335244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539af4b2-8337-46b4-bb15-9d89e113c008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:39.335846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af4b2-8337-46b4-bb15-9d89e113c008 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:39.336124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af4b2-8337-46b4-bb15-9d89e113c008 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:39.336395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af4b2-8337-46b4-bb15-9d89e113c008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:39.338057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-539af4b2-8337-46b4-bb15-9d89e113c008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:39.349317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:39.456746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539af4b2-8337-46b4-bb15-9d89e113c008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:39.458238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539af4b2-8337-46b4-bb15-9d89e113c008 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:39.476793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 747/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:48.844973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=82 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:49.474452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=50 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:04.166154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16014e51-ec4b-4bcb-8df2-9600332a59ff None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:04.166719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16014e51-ec4b-4bcb-8df2-9600332a59ff None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:04.166719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16014e51-ec4b-4bcb-8df2-9600332a59ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:04.248502 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-16014e51-ec4b-4bcb-8df2-9600332a59ff None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:04.249764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-16014e51-ec4b-4bcb-8df2-9600332a59ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:04.346737 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 747/1494] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:04.354933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be0e4-af85-47a2-b30a-a28d9569bd2f None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:04.355454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be0e4-af85-47a2-b30a-a28d9569bd2f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:04.355562 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be0e4-af85-47a2-b30a-a28d9569bd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:04.431862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-be1be0e4-af85-47a2-b30a-a28d9569bd2f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:04.433085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-be1be0e4-af85-47a2-b30a-a28d9569bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:04.534355 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 748/1495] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:04.539085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16014e51-ec4b-4bcb-8df2-9600332a59ff None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:04.540331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-16014e51-ec4b-4bcb-8df2-9600332a59ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:04.552176 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16014e51-ec4b-4bcb-8df2-9600332a59ff None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:04.615059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:04.650806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:04.651446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:04.651720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:04.651976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:04.652649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:24:04.652950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:04.653988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WARNING py.warnings [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:24:04.653988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: warnings.warn(msg) Aug 31 19:24:04.653988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: Aug 31 19:24:04.655514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:04.666230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 748/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:24:04.675164 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be0e4-af85-47a2-b30a-a28d9569bd2f None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:04.685030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be0e4-af85-47a2-b30a-a28d9569bd2f None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:04.745789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:04.780320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7ef6-f4f7-4dbe-bf66-5f56f15d0fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:04.780933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7ef6-f4f7-4dbe-bf66-5f56f15d0fad admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:04.781212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7ef6-f4f7-4dbe-bf66-5f56f15d0fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:04.781481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7ef6-f4f7-4dbe-bf66-5f56f15d0fad admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:04.782168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a7ef6-f4f7-4dbe-bf66-5f56f15d0fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:04.783912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: WARNING py.warnings [None req-087a7ef6-f4f7-4dbe-bf66-5f56f15d0fad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:24:04.783912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: warnings.warn(msg) Aug 31 19:24:04.783912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: Aug 31 19:24:04.785111 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a7ef6-f4f7-4dbe-bf66-5f56f15d0fad admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:04.929624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 749/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:24:04 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:24:04.934030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:04.935621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:04.968973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9505efc-cae0-48e0-a3eb-3e7864418ac1 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:05.067812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b512178-4ba4-4c5d-9796-67f1f781d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:05.068406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512178-4ba4-4c5d-9796-67f1f781d962 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:05.068681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512178-4ba4-4c5d-9796-67f1f781d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:05.068949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512178-4ba4-4c5d-9796-67f1f781d962 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:05.069580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b512178-4ba4-4c5d-9796-67f1f781d962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:05.070652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WARNING py.warnings [None req-9b512178-4ba4-4c5d-9796-67f1f781d962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:24:05.070652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: warnings.warn(msg) Aug 31 19:24:05.070652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: Aug 31 19:24:05.073439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b512178-4ba4-4c5d-9796-67f1f781d962 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:05.226213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 749/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:24:04 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:24:05.230862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7ef6-f4f7-4dbe-bf66-5f56f15d0fad admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:05.232404 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-087a7ef6-f4f7-4dbe-bf66-5f56f15d0fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:05.298654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7ef6-f4f7-4dbe-bf66-5f56f15d0fad admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:05.387039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:05.398556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9bccf-4dd3-4777-9358-2494fc8c0806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:05.399651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9bccf-4dd3-4777-9358-2494fc8c0806 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:05.399651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9bccf-4dd3-4777-9358-2494fc8c0806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:05.399844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9bccf-4dd3-4777-9358-2494fc8c0806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:05.400448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9bccf-4dd3-4777-9358-2494fc8c0806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:05.401458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: WARNING py.warnings [None req-34e9bccf-4dd3-4777-9358-2494fc8c0806 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:24:05.401458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: warnings.warn(msg) Aug 31 19:24:05.401458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: Aug 31 19:24:05.403101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9bccf-4dd3-4777-9358-2494fc8c0806 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:05.416931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 750/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:24:05.421023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b512178-4ba4-4c5d-9796-67f1f781d962 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:05.422650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9b512178-4ba4-4c5d-9796-67f1f781d962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:05.434037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b512178-4ba4-4c5d-9796-67f1f781d962 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:05.460086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:05.534353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337762f7-4ec0-420b-96d0-fcbf018bfcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:05.534879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337762f7-4ec0-420b-96d0-fcbf018bfcda admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:05.535157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337762f7-4ec0-420b-96d0-fcbf018bfcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:05.535427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337762f7-4ec0-420b-96d0-fcbf018bfcda admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:05.536079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337762f7-4ec0-420b-96d0-fcbf018bfcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:05.537089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WARNING py.warnings [None req-337762f7-4ec0-420b-96d0-fcbf018bfcda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:24:05.537089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: warnings.warn(msg) Aug 31 19:24:05.537089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: Aug 31 19:24:05.538029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337762f7-4ec0-420b-96d0-fcbf018bfcda admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:05.550904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 750/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:24:05.555384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9bccf-4dd3-4777-9358-2494fc8c0806 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:05.556908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-34e9bccf-4dd3-4777-9358-2494fc8c0806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:05.592372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9bccf-4dd3-4777-9358-2494fc8c0806 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:05.691531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4d76a-d919-43aa-b0e9-5e33022957e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:05.692190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d76a-d919-43aa-b0e9-5e33022957e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:05.692471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d76a-d919-43aa-b0e9-5e33022957e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:05.692745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d76a-d919-43aa-b0e9-5e33022957e9 admin admin] PATH_INFO: `/v3/projects/b062c45805184927af203c32beb6ce58/users/2df8dff0de344bff90b2d26621e88dff/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:05.717433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4d76a-d919-43aa-b0e9-5e33022957e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b062c45805184927af203c32beb6ce58, user_id=2df8dff0de344bff90b2d26621e88dff, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:05.718509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: WARNING py.warnings [None req-deb4d76a-d919-43aa-b0e9-5e33022957e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:24:05.718509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: warnings.warn(msg) Aug 31 19:24:05.718509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: Aug 31 19:24:05.720459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4d76a-d919-43aa-b0e9-5e33022957e9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:05.808305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 751/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:24:05 2022] PUT /identity/v3/projects/b062c45805184927af203c32beb6ce58/users/2df8dff0de344bff90b2d26621e88dff/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:24:05.820909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404df39a-fb90-42c9-b13c-bca5e708aa0b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:05.821197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404df39a-fb90-42c9-b13c-bca5e708aa0b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:05.822889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404df39a-fb90-42c9-b13c-bca5e708aa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:05.882187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-404df39a-fb90-42c9-b13c-bca5e708aa0b None None] MFA Rules not processed for user `2df8dff0de344bff90b2d26621e88dff`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:05.883429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-404df39a-fb90-42c9-b13c-bca5e708aa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:05.985139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 751/1502] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:24:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:05.999167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458d0c-4783-4613-9530-48f698dcbb82 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:05.999455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458d0c-4783-4613-9530-48f698dcbb82 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:05.999738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458d0c-4783-4613-9530-48f698dcbb82 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:06.001124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 752/1503] 10.222.0.42 () {54 vars in 964 bytes} [Wed Aug 31 19:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:06.006700 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c238d0f-a91d-4304-b6ac-1c5cddbee61d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:06.006987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c238d0f-a91d-4304-b6ac-1c5cddbee61d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:06.007262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c238d0f-a91d-4304-b6ac-1c5cddbee61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:06.041488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:06.090173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4c238d0f-a91d-4304-b6ac-1c5cddbee61d None None] MFA Rules not processed for user `953c57f22b304dcda6fcaba3fb01d666`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:06.091509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4c238d0f-a91d-4304-b6ac-1c5cddbee61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:06.174329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 752/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Aug 31 19:24:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:06.184103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d458d0c-4783-4613-9530-48f698dcbb82 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:06.186234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4d458d0c-4783-4613-9530-48f698dcbb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:06.236614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:06.290612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d458d0c-4783-4613-9530-48f698dcbb82 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:06.363361 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e131cd-b9de-487f-9b07-cb1c7984d38c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:06.363913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e131cd-b9de-487f-9b07-cb1c7984d38c service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:06.364193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e131cd-b9de-487f-9b07-cb1c7984d38c service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:06.364460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e131cd-b9de-487f-9b07-cb1c7984d38c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:06.366077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e6e131cd-b9de-487f-9b07-cb1c7984d38c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:06.466774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e131cd-b9de-487f-9b07-cb1c7984d38c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:06.468216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e131cd-b9de-487f-9b07-cb1c7984d38c service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:06.471653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:06.486148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 753/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:06.533175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b1f5d-d785-4f86-9854-b3ec286ecccb None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:06.533709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b1f5d-d785-4f86-9854-b3ec286ecccb None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:06.534276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b1f5d-d785-4f86-9854-b3ec286ecccb None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:06.535269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 753/1506] 10.222.0.42 () {52 vars in 830 bytes} [Wed Aug 31 19:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:24:06.539822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e131cd-b9de-487f-9b07-cb1c7984d38c service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:06.541160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e6e131cd-b9de-487f-9b07-cb1c7984d38c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:06.645080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e131cd-b9de-487f-9b07-cb1c7984d38c service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:06.742105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:06.742842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:06.743128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:06.743405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] PATH_INFO: `/v3/users/2df8dff0de344bff90b2d26621e88dff` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:06.755750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df8dff0de344bff90b2d26621e88dff)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:06.756774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: WARNING py.warnings [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:24:06.756774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: warnings.warn(msg) Aug 31 19:24:06.756774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: Aug 31 19:24:06.758061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:06.768346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:07.013731 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df8dff0de344bff90b2d26621e88dff'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:07.069503 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df8dff0de344bff90b2d26621e88dff'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:07.070065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df8dff0de344bff90b2d26621e88dff'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:07.097642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df8dff0de344bff90b2d26621e88dff'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:07.098150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df8dff0de344bff90b2d26621e88dff'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:07.118441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 754/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:24:06 2022] DELETE /identity/v3/users/2df8dff0de344bff90b2d26621e88dff => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:24:07.123544 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0fa14-ce80-4e07-aff8-d34e21660731 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:07.123829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0fa14-ce80-4e07-aff8-d34e21660731 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:07.124134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0fa14-ce80-4e07-aff8-d34e21660731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:07.182325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-60b0fa14-ce80-4e07-aff8-d34e21660731 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:07.184200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-60b0fa14-ce80-4e07-aff8-d34e21660731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:07.259944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:07.273526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 754/1508] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:07.283313 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:07.284474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:07.387131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1fcba-1cd6-4c3d-93f7-e416af06de5f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:07.443550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:07.462726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e1922-a64f-48b9-9a88-5c4e431f21d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:07.463350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e1922-a64f-48b9-9a88-5c4e431f21d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:07.463625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e1922-a64f-48b9-9a88-5c4e431f21d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:07.463897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e1922-a64f-48b9-9a88-5c4e431f21d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:07.465548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-973e1922-a64f-48b9-9a88-5c4e431f21d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:07.589391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e1922-a64f-48b9-9a88-5c4e431f21d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:07.590807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e1922-a64f-48b9-9a88-5c4e431f21d7 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:07.610105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 755/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:08.211469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0fa14-ce80-4e07-aff8-d34e21660731 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:08.212074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-60b0fa14-ce80-4e07-aff8-d34e21660731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:08.226877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0fa14-ce80-4e07-aff8-d34e21660731 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:08.336218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:08.336853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:08.337143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:08.337413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] PATH_INFO: `/v3/projects/b062c45805184927af203c32beb6ce58` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:08.348204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b062c45805184927af203c32beb6ce58)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:08.349236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WARNING py.warnings [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:24:08.349236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: warnings.warn(msg) Aug 31 19:24:08.349236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: Aug 31 19:24:08.350508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:08.531916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b062c45805184927af203c32beb6ce58', 'request_id': 'req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:08.545779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b062c45805184927af203c32beb6ce58', 'request_id': 'req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:08.663688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b062c45805184927af203c32beb6ce58', 'request_id': 'req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:08.690574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] The token cache is being invalidate because project b062c45805184927af203c32beb6ce58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:24:08.690875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:08.691541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f3d0086e-038a-4d7d-b56e-3faea98a6b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:08.693528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 755/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:24:08 2022] DELETE /identity/v3/projects/b062c45805184927af203c32beb6ce58 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:24:17.607504 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=62 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:18.688037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:52.449455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6f26a-3785-4a56-8739-a5b56276cda6 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:52.450159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6f26a-3785-4a56-8739-a5b56276cda6 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:52.450159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6f26a-3785-4a56-8739-a5b56276cda6 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:52.452320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:25:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:52.458346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429bc7-f573-4bcb-900b-c241d3503705 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:52.458947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429bc7-f573-4bcb-900b-c241d3503705 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:52.458947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429bc7-f573-4bcb-900b-c241d3503705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:52.550235 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-f4429bc7-f573-4bcb-900b-c241d3503705 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:52.551506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f4429bc7-f573-4bcb-900b-c241d3503705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:52.678817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:52.835034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6f26a-3785-4a56-8739-a5b56276cda6 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:52.837529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-29e6f26a-3785-4a56-8739-a5b56276cda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:52.984604 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6f26a-3785-4a56-8739-a5b56276cda6 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:52.990659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212d630-89f7-4a93-bd0e-9636da0a8792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:52.991344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d630-89f7-4a93-bd0e-9636da0a8792 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:52.991627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d630-89f7-4a93-bd0e-9636da0a8792 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:52.991905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d630-89f7-4a93-bd0e-9636da0a8792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:53.001069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212d630-89f7-4a93-bd0e-9636da0a8792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:53.002738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212d630-89f7-4a93-bd0e-9636da0a8792 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:53.013490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 757/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:53.886413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbef93b-ff4a-475e-9e1d-39f46bb79c38 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:53.887075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbef93b-ff4a-475e-9e1d-39f46bb79c38 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:53.887075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbef93b-ff4a-475e-9e1d-39f46bb79c38 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:53.888413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:25:53.893657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd779-2186-42e1-9a17-86ae20d2bc50 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:53.894131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd779-2186-42e1-9a17-86ae20d2bc50 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:53.894301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd779-2186-42e1-9a17-86ae20d2bc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:53.915240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e5dfd779-2186-42e1-9a17-86ae20d2bc50 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:53.916531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e5dfd779-2186-42e1-9a17-86ae20d2bc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:53.925349 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:25:54.083626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbef93b-ff4a-475e-9e1d-39f46bb79c38 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:54.100862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbef93b-ff4a-475e-9e1d-39f46bb79c38 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:54.106642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc0144-93ed-4853-bc93-1bab96fa6e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:54.107324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc0144-93ed-4853-bc93-1bab96fa6e92 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:54.107604 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc0144-93ed-4853-bc93-1bab96fa6e92 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:54.107876 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc0144-93ed-4853-bc93-1bab96fa6e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:54.117005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc0144-93ed-4853-bc93-1bab96fa6e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:54.118549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc0144-93ed-4853-bc93-1bab96fa6e92 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:54.128489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 758/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:56.882004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83384fcc-8827-4316-90e1-593eeeacbe5c None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.882656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83384fcc-8827-4316-90e1-593eeeacbe5c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.882656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83384fcc-8827-4316-90e1-593eeeacbe5c None None] PATH_INFO: `/v3` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.884020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 759/1517] 10.222.0.60 () {54 vars in 925 bytes} [Wed Aug 31 19:25:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:56.894183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf107c9-e737-4464-937e-b0e8b449a79d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.894993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf107c9-e737-4464-937e-b0e8b449a79d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.895190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf107c9-e737-4464-937e-b0e8b449a79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.979019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-dbf107c9-e737-4464-937e-b0e8b449a79d None None] MFA Rules not processed for user `b98cb3da3efe49acbfe640366bf7b53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:56.980280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-dbf107c9-e737-4464-937e-b0e8b449a79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:56.998877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:57.065116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 759/1518] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Aug 31 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:03.909802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=56 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:05.397477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46119b80-f5ff-485b-aac0-ff9589b7f971 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:05.398177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46119b80-f5ff-485b-aac0-ff9589b7f971 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:05.398177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46119b80-f5ff-485b-aac0-ff9589b7f971 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:05.399446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 760/1519] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:05.405436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa5588-4ed1-4953-9720-a1fd9fc169f8 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:05.405973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa5588-4ed1-4953-9720-a1fd9fc169f8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:05.406141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa5588-4ed1-4953-9720-a1fd9fc169f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:05.426472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-33fa5588-4ed1-4953-9720-a1fd9fc169f8 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:05.427715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-33fa5588-4ed1-4953-9720-a1fd9fc169f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:05.436366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 760/1520] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:05.592716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46119b80-f5ff-485b-aac0-ff9589b7f971 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:05.608282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46119b80-f5ff-485b-aac0-ff9589b7f971 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:05.613852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44585a8c-740f-4c27-af0d-f6b65296798d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:05.614468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585a8c-740f-4c27-af0d-f6b65296798d service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:05.614754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585a8c-740f-4c27-af0d-f6b65296798d service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:05.615130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585a8c-740f-4c27-af0d-f6b65296798d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:05.623545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44585a8c-740f-4c27-af0d-f6b65296798d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:05.625167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44585a8c-740f-4c27-af0d-f6b65296798d service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:05.635538 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 761/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:06.481232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2451-d1ae-4156-8e13-0a8131f65ebd None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:06.481836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2451-d1ae-4156-8e13-0a8131f65ebd None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:06.481836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2451-d1ae-4156-8e13-0a8131f65ebd None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:06.483244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:06.488374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700913-8a56-4720-b97a-dffce39d0cc5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:06.488833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700913-8a56-4720-b97a-dffce39d0cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:06.488942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700913-8a56-4720-b97a-dffce39d0cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:06.508681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-67700913-8a56-4720-b97a-dffce39d0cc5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:06.511244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-67700913-8a56-4720-b97a-dffce39d0cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:06.518209 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:06.676900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c2451-d1ae-4156-8e13-0a8131f65ebd None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:06.691290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c2451-d1ae-4156-8e13-0a8131f65ebd None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:06.697974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a37ecf-91a6-4309-b4c4-70303856df56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:06.701867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a37ecf-91a6-4309-b4c4-70303856df56 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:06.701867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a37ecf-91a6-4309-b4c4-70303856df56 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:06.701867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a37ecf-91a6-4309-b4c4-70303856df56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:06.709656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a37ecf-91a6-4309-b4c4-70303856df56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:06.711296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a37ecf-91a6-4309-b4c4-70303856df56 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:06.721088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 762/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:08.867253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8878ced-9b20-4dc2-a296-793bb7c44e00 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:08.868066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8878ced-9b20-4dc2-a296-793bb7c44e00 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:08.868066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8878ced-9b20-4dc2-a296-793bb7c44e00 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:08.869192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 763/1525] 10.222.0.42 () {54 vars in 961 bytes} [Wed Aug 31 19:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:26:08.874919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721e5c1-692e-40b4-8ccc-3467b6839e60 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:08.875519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721e5c1-692e-40b4-8ccc-3467b6839e60 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:08.875682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721e5c1-692e-40b4-8ccc-3467b6839e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:08.897320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-b721e5c1-692e-40b4-8ccc-3467b6839e60 None None] MFA Rules not processed for user `b98cb3da3efe49acbfe640366bf7b53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:08.898622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b721e5c1-692e-40b4-8ccc-3467b6839e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:08.907562 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 763/1526] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Aug 31 19:26:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:08.915929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8878ced-9b20-4dc2-a296-793bb7c44e00 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:08.931766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8878ced-9b20-4dc2-a296-793bb7c44e00 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:08.937092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc61def-089c-4702-8ea1-032ed26c6683 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:08.937743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc61def-089c-4702-8ea1-032ed26c6683 service placement] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:08.938025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc61def-089c-4702-8ea1-032ed26c6683 service placement] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:08.938310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc61def-089c-4702-8ea1-032ed26c6683 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:08.947834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc61def-089c-4702-8ea1-032ed26c6683 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:08.949828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc61def-089c-4702-8ea1-032ed26c6683 service placement] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:08.962398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 764/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:18.012411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9390e-5cba-480a-9f07-5c60d146b1f4 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:18.012989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9390e-5cba-480a-9f07-5c60d146b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:18.012989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9390e-5cba-480a-9f07-5c60d146b1f4 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:18.014354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:18.019097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985da5f-b5d5-4197-be46-c5e674f6e4f3 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:18.019749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985da5f-b5d5-4197-be46-c5e674f6e4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:18.019749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985da5f-b5d5-4197-be46-c5e674f6e4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:18.039155 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-7985da5f-b5d5-4197-be46-c5e674f6e4f3 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:18.040341 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7985da5f-b5d5-4197-be46-c5e674f6e4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:18.048024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:18.202851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9390e-5cba-480a-9f07-5c60d146b1f4 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:18.218402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9390e-5cba-480a-9f07-5c60d146b1f4 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:18.223778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85360-6cff-4d3b-90db-a07da1e0b834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:18.224411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85360-6cff-4d3b-90db-a07da1e0b834 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:18.224692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85360-6cff-4d3b-90db-a07da1e0b834 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:18.224960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85360-6cff-4d3b-90db-a07da1e0b834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:18.234756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c85360-6cff-4d3b-90db-a07da1e0b834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:18.236418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c85360-6cff-4d3b-90db-a07da1e0b834 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:18.246626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 765/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:19.078289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570156-1fbc-46cf-aeb0-bb68f7615ffd None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:19.078889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570156-1fbc-46cf-aeb0-bb68f7615ffd None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:19.078889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570156-1fbc-46cf-aeb0-bb68f7615ffd None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:19.080439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:19.086741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731902a-25fc-43b6-93ce-2993e2827e6a None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:19.087145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731902a-25fc-43b6-93ce-2993e2827e6a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:19.087319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731902a-25fc-43b6-93ce-2993e2827e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:19.107241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-0731902a-25fc-43b6-93ce-2993e2827e6a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:19.108463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0731902a-25fc-43b6-93ce-2993e2827e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:19.116211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:19.268936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd570156-1fbc-46cf-aeb0-bb68f7615ffd None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:19.283421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd570156-1fbc-46cf-aeb0-bb68f7615ffd None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:19.289391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45a66c-75a5-4982-b4fc-3746224af732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:19.290020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45a66c-75a5-4982-b4fc-3746224af732 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:19.290295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45a66c-75a5-4982-b4fc-3746224af732 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:19.290570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45a66c-75a5-4982-b4fc-3746224af732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:19.298495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45a66c-75a5-4982-b4fc-3746224af732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:19.300062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45a66c-75a5-4982-b4fc-3746224af732 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:19.309323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 767/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:26:23.286023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e7f3b-258d-4fa1-9a45-c2f0efb4b516 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:23.287101 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e7f3b-258d-4fa1-9a45-c2f0efb4b516 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:23.287101 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e7f3b-258d-4fa1-9a45-c2f0efb4b516 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:23.288749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:23.293801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b2159-cb9f-487b-b469-a73cb73878f1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:23.294220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b2159-cb9f-487b-b469-a73cb73878f1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:23.294380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b2159-cb9f-487b-b469-a73cb73878f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:23.314530 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-fc5b2159-cb9f-487b-b469-a73cb73878f1 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:23.315711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-fc5b2159-cb9f-487b-b469-a73cb73878f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:23.324532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:23.618487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e7f3b-258d-4fa1-9a45-c2f0efb4b516 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:23.620183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cb9e7f3b-258d-4fa1-9a45-c2f0efb4b516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:23.700103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e7f3b-258d-4fa1-9a45-c2f0efb4b516 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:23.703896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27734e-e6bd-46e4-b177-b04d8a495f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:23.704766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27734e-e6bd-46e4-b177-b04d8a495f83 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:23.705044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27734e-e6bd-46e4-b177-b04d8a495f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:23.705318 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27734e-e6bd-46e4-b177-b04d8a495f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:23.715635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27734e-e6bd-46e4-b177-b04d8a495f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:23.717075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27734e-e6bd-46e4-b177-b04d8a495f83 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:23.727586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 768/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:25.636488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74c66c-e15f-4bc2-85e3-746e8cf83a10 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:25.637005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74c66c-e15f-4bc2-85e3-746e8cf83a10 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:25.637005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74c66c-e15f-4bc2-85e3-746e8cf83a10 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:25.638417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:25.643703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de9f7e-9a6c-4e80-9a55-fc4fcc70c7af None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:25.644124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de9f7e-9a6c-4e80-9a55-fc4fcc70c7af None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:25.644264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de9f7e-9a6c-4e80-9a55-fc4fcc70c7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:25.664133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-15de9f7e-9a6c-4e80-9a55-fc4fcc70c7af None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:25.665335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-15de9f7e-9a6c-4e80-9a55-fc4fcc70c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:25.673213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:26:25.968504 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74c66c-e15f-4bc2-85e3-746e8cf83a10 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:25.980717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74c66c-e15f-4bc2-85e3-746e8cf83a10 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:25.984348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d870bd-feca-48a8-8328-a44ecaa961b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:25.984955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d870bd-feca-48a8-8328-a44ecaa961b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:25.985302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d870bd-feca-48a8-8328-a44ecaa961b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:25.985580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d870bd-feca-48a8-8328-a44ecaa961b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:25.995602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d870bd-feca-48a8-8328-a44ecaa961b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:25.997038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d870bd-feca-48a8-8328-a44ecaa961b1 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:26.007212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 770/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:29.537921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056406a-456e-47f2-b52d-64bb828a60c8 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:29.538498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056406a-456e-47f2-b52d-64bb828a60c8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:29.538498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056406a-456e-47f2-b52d-64bb828a60c8 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:29.539831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 770/1540] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:29.545303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b77523-6cfe-4a81-9562-a7d65de7ee94 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:29.545771 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b77523-6cfe-4a81-9562-a7d65de7ee94 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:29.545893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b77523-6cfe-4a81-9562-a7d65de7ee94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:29.565617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-d4b77523-6cfe-4a81-9562-a7d65de7ee94 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:29.566848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d4b77523-6cfe-4a81-9562-a7d65de7ee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:29.575372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 771/1541] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:30.135454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056406a-456e-47f2-b52d-64bb828a60c8 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:30.137155 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f056406a-456e-47f2-b52d-64bb828a60c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:30.141242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=83 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:30.217264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056406a-456e-47f2-b52d-64bb828a60c8 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:30.220854 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6619-5aeb-43c9-82e2-1819e1cbd1c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:30.221457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6619-5aeb-43c9-82e2-1819e1cbd1c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:30.221779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6619-5aeb-43c9-82e2-1819e1cbd1c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:30.222052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6619-5aeb-43c9-82e2-1819e1cbd1c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:30.231080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e6619-5aeb-43c9-82e2-1819e1cbd1c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:30.232516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e6619-5aeb-43c9-82e2-1819e1cbd1c9 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:30.242503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 771/1542] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:32.178489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061ad0d-55b2-4b49-843d-c3f345d3d566 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:32.179045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061ad0d-55b2-4b49-843d-c3f345d3d566 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:32.179045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061ad0d-55b2-4b49-843d-c3f345d3d566 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:32.180386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 772/1543] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:32.185500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035415f6-0b6e-47eb-a76b-202d52c88c15 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:32.185908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035415f6-0b6e-47eb-a76b-202d52c88c15 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:32.186074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035415f6-0b6e-47eb-a76b-202d52c88c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:32.205463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-035415f6-0b6e-47eb-a76b-202d52c88c15 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:32.206717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-035415f6-0b6e-47eb-a76b-202d52c88c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:32.214806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 772/1544] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:32.781028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061ad0d-55b2-4b49-843d-c3f345d3d566 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:32.782787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d061ad0d-55b2-4b49-843d-c3f345d3d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:32.797878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061ad0d-55b2-4b49-843d-c3f345d3d566 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:32.801331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae4e1c-a6f9-418e-bd3f-c87ca083c236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:32.802630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4e1c-a6f9-418e-bd3f-c87ca083c236 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:32.802916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4e1c-a6f9-418e-bd3f-c87ca083c236 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:32.803196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4e1c-a6f9-418e-bd3f-c87ca083c236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:32.812704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae4e1c-a6f9-418e-bd3f-c87ca083c236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:32.814234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae4e1c-a6f9-418e-bd3f-c87ca083c236 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:32.824397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 773/1545] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:42.199761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=37 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:42.819999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=42 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:12.993343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08d3a-edea-4f55-975d-6b245912d865 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:12.994603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08d3a-edea-4f55-975d-6b245912d865 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:12.995153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08d3a-edea-4f55-975d-6b245912d865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.026591 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-f2f08d3a-edea-4f55-975d-6b245912d865 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.028429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f2f08d3a-edea-4f55-975d-6b245912d865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.038844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 773/1546] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:13.047786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7a09-0fcc-4797-a9d0-4707e4e0b9d5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.048365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7a09-0fcc-4797-a9d0-4707e4e0b9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.048600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7a09-0fcc-4797-a9d0-4707e4e0b9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.084446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-829d7a09-0fcc-4797-a9d0-4707e4e0b9d5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.085756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-829d7a09-0fcc-4797-a9d0-4707e4e0b9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.095097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 774/1547] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.102138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08d3a-edea-4f55-975d-6b245912d865 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:13.121941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08d3a-edea-4f55-975d-6b245912d865 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:13.134544 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034fe52-23d8-4a66-aacd-9a108ca5ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:13.135719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034fe52-23d8-4a66-aacd-9a108ca5ffd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.136334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034fe52-23d8-4a66-aacd-9a108ca5ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.137071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034fe52-23d8-4a66-aacd-9a108ca5ffd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.138450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034fe52-23d8-4a66-aacd-9a108ca5ffd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:13.139107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034fe52-23d8-4a66-aacd-9a108ca5ffd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:13.141135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034fe52-23d8-4a66-aacd-9a108ca5ffd6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:13.157720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 774/1548] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:13.167076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d7a09-0fcc-4797-a9d0-4707e4e0b9d5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:13.183446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d7a09-0fcc-4797-a9d0-4707e4e0b9d5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:13.188777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2c75e-acf9-4ee5-971b-9f90b23914dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:13.189420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2c75e-acf9-4ee5-971b-9f90b23914dd admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.189804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2c75e-acf9-4ee5-971b-9f90b23914dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.190581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2c75e-acf9-4ee5-971b-9f90b23914dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.191249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2c75e-acf9-4ee5-971b-9f90b23914dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:13.193370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2c75e-acf9-4ee5-971b-9f90b23914dd admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:13.283975 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329c09-6ccf-4150-842a-5078d547e74a None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.284784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329c09-6ccf-4150-842a-5078d547e74a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.285428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329c09-6ccf-4150-842a-5078d547e74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.318799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-af329c09-6ccf-4150-842a-5078d547e74a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.400204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-af329c09-6ccf-4150-842a-5078d547e74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.400204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 775/1549] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.400204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86d464-102a-471e-87df-ccb725d52fd5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.400204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86d464-102a-471e-87df-ccb725d52fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.400204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86d464-102a-471e-87df-ccb725d52fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.400204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-da86d464-102a-471e-87df-ccb725d52fd5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.400823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-da86d464-102a-471e-87df-ccb725d52fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.400823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 776/1550] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.400823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37286e-f642-47ac-ad8c-32712bd343c8 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.400823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37286e-f642-47ac-ad8c-32712bd343c8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.400823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37286e-f642-47ac-ad8c-32712bd343c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.411763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-cc37286e-f642-47ac-ad8c-32712bd343c8 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.413124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cc37286e-f642-47ac-ad8c-32712bd343c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.421939 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 777/1551] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.423325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7db4-5a7c-4808-bb4d-ec202864fbc7 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.423617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7db4-5a7c-4808-bb4d-ec202864fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.423895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7db4-5a7c-4808-bb4d-ec202864fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.451049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-516c7db4-5a7c-4808-bb4d-ec202864fbc7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.452407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-516c7db4-5a7c-4808-bb4d-ec202864fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.461744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 778/1552] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.462596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c72c1-d6c1-4943-a84d-60f7e385993d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.462935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c72c1-d6c1-4943-a84d-60f7e385993d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.463154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c72c1-d6c1-4943-a84d-60f7e385993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.468299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 775/1553] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/projects => generated 403 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:13.469858 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e8806-6b66-4631-8502-fda1180c7844 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.470294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e8806-6b66-4631-8502-fda1180c7844 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.471516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e8806-6b66-4631-8502-fda1180c7844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.483698 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-957c72c1-d6c1-4943-a84d-60f7e385993d None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.485955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-957c72c1-d6c1-4943-a84d-60f7e385993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.499447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a06e8806-6b66-4631-8502-fda1180c7844 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.500828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a06e8806-6b66-4631-8502-fda1180c7844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.557149 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 779/1554] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.558522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5171d9-13e8-48df-a048-942f554aef14 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.558908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5171d9-13e8-48df-a048-942f554aef14 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.559302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5171d9-13e8-48df-a048-942f554aef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.569767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 776/1555] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.577639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69a9c5-afd8-410e-8302-a5a8112b9640 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.577639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69a9c5-afd8-410e-8302-a5a8112b9640 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.577639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69a9c5-afd8-410e-8302-a5a8112b9640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.585757 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4e5171d9-13e8-48df-a048-942f554aef14 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.587135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4e5171d9-13e8-48df-a048-942f554aef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.592081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-db69a9c5-afd8-410e-8302-a5a8112b9640 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.593256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-db69a9c5-afd8-410e-8302-a5a8112b9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.595298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 780/1556] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.597369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e199a-041b-464e-b701-ab142f479883 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.597586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e199a-041b-464e-b701-ab142f479883 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.597826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e199a-041b-464e-b701-ab142f479883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.604086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 777/1557] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.605044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69a9c5-afd8-410e-8302-a5a8112b9640 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:13.615593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69a9c5-afd8-410e-8302-a5a8112b9640 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:13.618918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-b32e199a-041b-464e-b701-ab142f479883 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.620118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b32e199a-041b-464e-b701-ab142f479883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.620624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b6121-0e96-4fbc-b346-d6e47e6c264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:13.621311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6121-0e96-4fbc-b346-d6e47e6c264a admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.621602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6121-0e96-4fbc-b346-d6e47e6c264a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.621910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6121-0e96-4fbc-b346-d6e47e6c264a admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.622580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b6121-0e96-4fbc-b346-d6e47e6c264a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:13.622876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b6121-0e96-4fbc-b346-d6e47e6c264a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:13.624043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: WARNING py.warnings [None req-171b6121-0e96-4fbc-b346-d6e47e6c264a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:28:13.624043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: warnings.warn(msg) Aug 31 19:28:13.624043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: Aug 31 19:28:13.624931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b6121-0e96-4fbc-b346-d6e47e6c264a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:13.628043 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 781/1558] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.628874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e199a-041b-464e-b701-ab142f479883 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:13.638359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 778/1559] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:13.651614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ab28-9de2-419c-bfa2-e63aad0dc4c6 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.651772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e199a-041b-464e-b701-ab142f479883 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:13.651879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ab28-9de2-419c-bfa2-e63aad0dc4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.651879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ab28-9de2-419c-bfa2-e63aad0dc4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.652026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d7f1-030c-46cf-89ec-c657b93c5699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:13.652026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d7f1-030c-46cf-89ec-c657b93c5699 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.652026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d7f1-030c-46cf-89ec-c657b93c5699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.652026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d7f1-030c-46cf-89ec-c657b93c5699 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.652330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d7f1-030c-46cf-89ec-c657b93c5699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:13.652330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d7f1-030c-46cf-89ec-c657b93c5699 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:13.664481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c403ab28-9de2-419c-bfa2-e63aad0dc4c6 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.665729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c403ab28-9de2-419c-bfa2-e63aad0dc4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.673651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 779/1560] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.674478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403ab28-9de2-419c-bfa2-e63aad0dc4c6 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:13.684061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403ab28-9de2-419c-bfa2-e63aad0dc4c6 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:13.688620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42811fa-b676-4604-949b-10091aefdf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:13.689191 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42811fa-b676-4604-949b-10091aefdf7d admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.689494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42811fa-b676-4604-949b-10091aefdf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.689827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42811fa-b676-4604-949b-10091aefdf7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.690497 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42811fa-b676-4604-949b-10091aefdf7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:13.690767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42811fa-b676-4604-949b-10091aefdf7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:13.692359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42811fa-b676-4604-949b-10091aefdf7d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:13.706629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 780/1561] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:13.708723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2863c2-8cdf-43f2-ab95-fb021f770a06 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.709013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2863c2-8cdf-43f2-ab95-fb021f770a06 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.709298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2863c2-8cdf-43f2-ab95-fb021f770a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.734247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-0e2863c2-8cdf-43f2-ab95-fb021f770a06 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.735452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0e2863c2-8cdf-43f2-ab95-fb021f770a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.743403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 781/1562] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.744555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4694a69-ad3e-4217-af0a-f589e26d5c83 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.744840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4694a69-ad3e-4217-af0a-f589e26d5c83 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.745114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4694a69-ad3e-4217-af0a-f589e26d5c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.764086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-f4694a69-ad3e-4217-af0a-f589e26d5c83 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.765275 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f4694a69-ad3e-4217-af0a-f589e26d5c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.834477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 782/1563] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.834477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c891d-2baf-451f-8f21-49b12e5cbb56 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.834477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c891d-2baf-451f-8f21-49b12e5cbb56 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.834477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c891d-2baf-451f-8f21-49b12e5cbb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.834477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b99c891d-2baf-451f-8f21-49b12e5cbb56 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:13.834477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b99c891d-2baf-451f-8f21-49b12e5cbb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:13.835558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 783/1564] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:13.835558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c891d-2baf-451f-8f21-49b12e5cbb56 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:13.835558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c891d-2baf-451f-8f21-49b12e5cbb56 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:13.835558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e57346-6b47-421d-9ede-d4d2137a7609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:13.835895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57346-6b47-421d-9ede-d4d2137a7609 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.835895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57346-6b47-421d-9ede-d4d2137a7609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.835895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57346-6b47-421d-9ede-d4d2137a7609 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.835895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e57346-6b47-421d-9ede-d4d2137a7609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:13.835895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e57346-6b47-421d-9ede-d4d2137a7609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:13.835895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e57346-6b47-421d-9ede-d4d2137a7609 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:13.836318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 784/1565] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:13.836318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e57346-6b47-421d-9ede-d4d2137a7609 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:13.848988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e57346-6b47-421d-9ede-d4d2137a7609 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:13.853642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70c711-38a6-4a1e-b319-379bd20d1bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:13.854276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70c711-38a6-4a1e-b319-379bd20d1bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:13.854563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70c711-38a6-4a1e-b319-379bd20d1bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:13.854846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70c711-38a6-4a1e-b319-379bd20d1bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:13.855542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70c711-38a6-4a1e-b319-379bd20d1bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:13.857440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70c711-38a6-4a1e-b319-379bd20d1bc0 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.104311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 782/1566] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/users => generated 302 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:14.105589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aca22-9eff-44c9-bae9-3ad5bc861049 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.105903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aca22-9eff-44c9-bae9-3ad5bc861049 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.106178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aca22-9eff-44c9-bae9-3ad5bc861049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.125951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e92aca22-9eff-44c9-bae9-3ad5bc861049 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:14.127164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e92aca22-9eff-44c9-bae9-3ad5bc861049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:14.134851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 783/1567] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:14.135581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aca22-9eff-44c9-bae9-3ad5bc861049 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.144783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aca22-9eff-44c9-bae9-3ad5bc861049 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.149188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767064c-5e4f-4f11-9c18-2ff200f4eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.149780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767064c-5e4f-4f11-9c18-2ff200f4eb37 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.150063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767064c-5e4f-4f11-9c18-2ff200f4eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.150327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767064c-5e4f-4f11-9c18-2ff200f4eb37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.150935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767064c-5e4f-4f11-9c18-2ff200f4eb37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.151940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WARNING py.warnings [None req-5767064c-5e4f-4f11-9c18-2ff200f4eb37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:28:14.151940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: warnings.warn(msg) Aug 31 19:28:14.151940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: Aug 31 19:28:14.153113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767064c-5e4f-4f11-9c18-2ff200f4eb37 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.358223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 785/1568] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:13 2022] POST /identity/v3/projects => generated 393 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:14.358972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70c711-38a6-4a1e-b319-379bd20d1bc0 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.389261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:14.418740 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70c711-38a6-4a1e-b319-379bd20d1bc0 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.423628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37102775-ab07-4e0a-8e31-e0b7e6af1906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.424717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37102775-ab07-4e0a-8e31-e0b7e6af1906 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.424995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37102775-ab07-4e0a-8e31-e0b7e6af1906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.425269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37102775-ab07-4e0a-8e31-e0b7e6af1906 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.425997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37102775-ab07-4e0a-8e31-e0b7e6af1906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:14.426328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37102775-ab07-4e0a-8e31-e0b7e6af1906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.427969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37102775-ab07-4e0a-8e31-e0b7e6af1906 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.436115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 784/1569] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:14 2022] POST /identity/v3/projects => generated 379 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:14.464930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767064c-5e4f-4f11-9c18-2ff200f4eb37 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.465083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 786/1570] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:14.465083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37102775-ab07-4e0a-8e31-e0b7e6af1906 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.465083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37102775-ab07-4e0a-8e31-e0b7e6af1906 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.497424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:14.502654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767064c-5e4f-4f11-9c18-2ff200f4eb37 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.508309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b01a-ac7f-4776-8043-bc56446c1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.508513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1214f1-a71f-4378-8e21-dffe378b671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.508935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b01a-ac7f-4776-8043-bc56446c1ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.509092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1214f1-a71f-4378-8e21-dffe378b671a admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.509195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b01a-ac7f-4776-8043-bc56446c1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.509350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1214f1-a71f-4378-8e21-dffe378b671a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.509506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b01a-ac7f-4776-8043-bc56446c1ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.509700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1214f1-a71f-4378-8e21-dffe378b671a admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.510176 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96b01a-ac7f-4776-8043-bc56446c1ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:14.510458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1214f1-a71f-4378-8e21-dffe378b671a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:14.510567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96b01a-ac7f-4776-8043-bc56446c1ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.510821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1214f1-a71f-4378-8e21-dffe378b671a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.512124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96b01a-ac7f-4776-8043-bc56446c1ec1 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.512527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1214f1-a71f-4378-8e21-dffe378b671a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.523934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 785/1571] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:14.538797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b01a-ac7f-4776-8043-bc56446c1ec1 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.538965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 787/1572] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:14.538965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1214f1-a71f-4378-8e21-dffe378b671a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.538965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1214f1-a71f-4378-8e21-dffe378b671a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.541992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b01a-ac7f-4776-8043-bc56446c1ec1 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.543020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e84c9-1aab-46ee-912f-90a3ab53967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.543635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e84c9-1aab-46ee-912f-90a3ab53967b admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.543920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e84c9-1aab-46ee-912f-90a3ab53967b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.544201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e84c9-1aab-46ee-912f-90a3ab53967b admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.544850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e84c9-1aab-46ee-912f-90a3ab53967b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.546475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e84c9-1aab-46ee-912f-90a3ab53967b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.546671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29cdcd-1610-4e2e-bda1-40900863d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.547303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cdcd-1610-4e2e-bda1-40900863d927 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.547575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cdcd-1610-4e2e-bda1-40900863d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.548093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29cdcd-1610-4e2e-bda1-40900863d927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.548727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29cdcd-1610-4e2e-bda1-40900863d927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.551282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29cdcd-1610-4e2e-bda1-40900863d927 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.560192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 788/1573] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:14.560192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e84c9-1aab-46ee-912f-90a3ab53967b admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.568215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e84c9-1aab-46ee-912f-90a3ab53967b admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.572970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e05ec9-9579-4bad-a834-b67c2b705926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.573563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05ec9-9579-4bad-a834-b67c2b705926 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.573872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05ec9-9579-4bad-a834-b67c2b705926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.574149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05ec9-9579-4bad-a834-b67c2b705926 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.574798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e05ec9-9579-4bad-a834-b67c2b705926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:14.575099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e05ec9-9579-4bad-a834-b67c2b705926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.576705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e05ec9-9579-4bad-a834-b67c2b705926 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.590082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 789/1574] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:14.590924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e05ec9-9579-4bad-a834-b67c2b705926 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.600617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e05ec9-9579-4bad-a834-b67c2b705926 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.605651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276963f4-ac58-49f4-8ced-fdefcfe1a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.606288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276963f4-ac58-49f4-8ced-fdefcfe1a942 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.606570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276963f4-ac58-49f4-8ced-fdefcfe1a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.606844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276963f4-ac58-49f4-8ced-fdefcfe1a942 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.607477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276963f4-ac58-49f4-8ced-fdefcfe1a942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.608541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: WARNING py.warnings [None req-276963f4-ac58-49f4-8ced-fdefcfe1a942 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:28:14.608541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: warnings.warn(msg) Aug 31 19:28:14.608541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: Aug 31 19:28:14.609712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276963f4-ac58-49f4-8ced-fdefcfe1a942 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.808662 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 786/1575] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:14 2022] POST /identity/v3/projects => generated 375 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:14.809477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29cdcd-1610-4e2e-bda1-40900863d927 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.868794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29cdcd-1610-4e2e-bda1-40900863d927 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.873616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e73f19-d893-4118-a80f-c78717acc798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.874361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e73f19-d893-4118-a80f-c78717acc798 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.874655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e73f19-d893-4118-a80f-c78717acc798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.874932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e73f19-d893-4118-a80f-c78717acc798 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.875564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e73f19-d893-4118-a80f-c78717acc798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.877587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e73f19-d893-4118-a80f-c78717acc798 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.885008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 790/1576] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:14 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:14.885008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276963f4-ac58-49f4-8ced-fdefcfe1a942 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.892647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276963f4-ac58-49f4-8ced-fdefcfe1a942 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.897288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315d220-fe6d-4de5-b335-9ffaf7e84c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.900357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315d220-fe6d-4de5-b335-9ffaf7e84c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.900357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315d220-fe6d-4de5-b335-9ffaf7e84c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.900357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315d220-fe6d-4de5-b335-9ffaf7e84c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.900357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315d220-fe6d-4de5-b335-9ffaf7e84c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.901098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315d220-fe6d-4de5-b335-9ffaf7e84c03 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:15.000897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 787/1577] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:14 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:15.000897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e73f19-d893-4118-a80f-c78717acc798 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:15.009051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e73f19-d893-4118-a80f-c78717acc798 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:15.014071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546841c2-e57c-4709-a11b-90860f461dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:15.014671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546841c2-e57c-4709-a11b-90860f461dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:15.014955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546841c2-e57c-4709-a11b-90860f461dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:15.015233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546841c2-e57c-4709-a11b-90860f461dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:15.015858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546841c2-e57c-4709-a11b-90860f461dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:15.017936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546841c2-e57c-4709-a11b-90860f461dc5 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:15.152409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 791/1578] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:14 2022] POST /identity/v3/projects => generated 385 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:15.153146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315d220-fe6d-4de5-b335-9ffaf7e84c03 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:15.213046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315d220-fe6d-4de5-b335-9ffaf7e84c03 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:15.217547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea24b2-0efa-4858-a6a5-2a7bc13ae6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:15.218178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea24b2-0efa-4858-a6a5-2a7bc13ae6cc admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:15.218462 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea24b2-0efa-4858-a6a5-2a7bc13ae6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:15.218735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea24b2-0efa-4858-a6a5-2a7bc13ae6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:15.219359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea24b2-0efa-4858-a6a5-2a7bc13ae6cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:15.221966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea24b2-0efa-4858-a6a5-2a7bc13ae6cc admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:15.232226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 788/1579] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:14 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:15.233076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546841c2-e57c-4709-a11b-90860f461dc5 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:15.293288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546841c2-e57c-4709-a11b-90860f461dc5 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:15.297870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf839c3-420d-41c7-b294-7c2e9dbf54ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:15.298471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf839c3-420d-41c7-b294-7c2e9dbf54ec admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:15.298754 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf839c3-420d-41c7-b294-7c2e9dbf54ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:15.299181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf839c3-420d-41c7-b294-7c2e9dbf54ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:15.299754 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf839c3-420d-41c7-b294-7c2e9dbf54ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:15.301287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf839c3-420d-41c7-b294-7c2e9dbf54ec admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:15.310846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 789/1580] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:15.311625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf839c3-420d-41c7-b294-7c2e9dbf54ec admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:15.320673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf839c3-420d-41c7-b294-7c2e9dbf54ec admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:15.325202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa70758-2cbf-4016-998f-ddec30e0aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:15.325798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa70758-2cbf-4016-998f-ddec30e0aa2d admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:15.326079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa70758-2cbf-4016-998f-ddec30e0aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:15.326362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa70758-2cbf-4016-998f-ddec30e0aa2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:15.326958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa70758-2cbf-4016-998f-ddec30e0aa2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:15.328785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa70758-2cbf-4016-998f-ddec30e0aa2d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:15.547035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 790/1581] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:15 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:15.547947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa70758-2cbf-4016-998f-ddec30e0aa2d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:15.548212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 792/1582] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:15 2022] POST /identity/v3/projects => generated 385 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:15.549030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea24b2-0efa-4858-a6a5-2a7bc13ae6cc admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:15.573390 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:15.615100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea24b2-0efa-4858-a6a5-2a7bc13ae6cc admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:15.615321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa70758-2cbf-4016-998f-ddec30e0aa2d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:15.621323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefdf63-b1d1-4542-8add-6a2a903fc82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:15.621465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c6ebd-690a-40d9-987a-a9763fc4e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:15.621581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefdf63-b1d1-4542-8add-6a2a903fc82a admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:15.621693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6ebd-690a-40d9-987a-a9763fc4e70a admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:15.621797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefdf63-b1d1-4542-8add-6a2a903fc82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:15.621913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6ebd-690a-40d9-987a-a9763fc4e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:15.621990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefdf63-b1d1-4542-8add-6a2a903fc82a admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:15.622086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6ebd-690a-40d9-987a-a9763fc4e70a admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:15.622175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefdf63-b1d1-4542-8add-6a2a903fc82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:15.622278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c6ebd-690a-40d9-987a-a9763fc4e70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:15.623003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefdf63-b1d1-4542-8add-6a2a903fc82a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:15.623553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c6ebd-690a-40d9-987a-a9763fc4e70a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:15.633366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 793/1583] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:15.634220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefdf63-b1d1-4542-8add-6a2a903fc82a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:15.643901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefdf63-b1d1-4542-8add-6a2a903fc82a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:15.648377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6570f6-24a1-4f49-a4bb-0af9b5b3b432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:15.648986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6570f6-24a1-4f49-a4bb-0af9b5b3b432 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:15.649265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6570f6-24a1-4f49-a4bb-0af9b5b3b432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:15.649536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6570f6-24a1-4f49-a4bb-0af9b5b3b432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:15.650206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6570f6-24a1-4f49-a4bb-0af9b5b3b432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:15.651772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6570f6-24a1-4f49-a4bb-0af9b5b3b432 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:15.662044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 794/1584] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:15.662811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6570f6-24a1-4f49-a4bb-0af9b5b3b432 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:15.672402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6570f6-24a1-4f49-a4bb-0af9b5b3b432 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:15.676958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222febc2-18ee-4438-ac6a-b13826fb163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:15.677537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222febc2-18ee-4438-ac6a-b13826fb163e admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:15.677854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222febc2-18ee-4438-ac6a-b13826fb163e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:15.678129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222febc2-18ee-4438-ac6a-b13826fb163e admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:15.678741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222febc2-18ee-4438-ac6a-b13826fb163e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:15.680604 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222febc2-18ee-4438-ac6a-b13826fb163e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:15.797446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:15.938905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 795/1586] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:15 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:15.939119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 791/1586] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:15 2022] POST /identity/v3/users => generated 288 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:15.939119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c6ebd-690a-40d9-987a-a9763fc4e70a admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:15.939295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222febc2-18ee-4438-ac6a-b13826fb163e admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:15.949041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222febc2-18ee-4438-ac6a-b13826fb163e admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:15.949196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c6ebd-690a-40d9-987a-a9763fc4e70a admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:15.953499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac817-1971-40e8-81a3-c605c35d5c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:15.953636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e26fb-475b-4973-bbc3-2a239524a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:15.954189 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac817-1971-40e8-81a3-c605c35d5c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:15.954310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e26fb-475b-4973-bbc3-2a239524a1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:15.954470 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac817-1971-40e8-81a3-c605c35d5c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:15.954622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e26fb-475b-4973-bbc3-2a239524a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:15.954727 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac817-1971-40e8-81a3-c605c35d5c6a admin admin] PATH_INFO: `/v3/projects/e2d41152f0374a4694120833721ef7ef/users/8af3239fb2aa411d826c92faa2f5e171/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:15.954884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e26fb-475b-4973-bbc3-2a239524a1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:15.955759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e26fb-475b-4973-bbc3-2a239524a1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:15.957692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e26fb-475b-4973-bbc3-2a239524a1e4 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:15.970024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ac817-1971-40e8-81a3-c605c35d5c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d41152f0374a4694120833721ef7ef, user_id=8af3239fb2aa411d826c92faa2f5e171, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:15.972688 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ac817-1971-40e8-81a3-c605c35d5c6a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.159526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 792/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:15 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:16.159526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e26fb-475b-4973-bbc3-2a239524a1e4 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.167375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e26fb-475b-4973-bbc3-2a239524a1e4 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:16.171985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17811b8-4ef2-4fb3-85f0-f3fc23fadc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:16.172574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17811b8-4ef2-4fb3-85f0-f3fc23fadc03 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.172855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17811b8-4ef2-4fb3-85f0-f3fc23fadc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.173152 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17811b8-4ef2-4fb3-85f0-f3fc23fadc03 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.173835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17811b8-4ef2-4fb3-85f0-f3fc23fadc03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:16.176262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17811b8-4ef2-4fb3-85f0-f3fc23fadc03 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.209075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 796/1588] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:15 2022] PUT /identity/v3/projects/e2d41152f0374a4694120833721ef7ef/users/8af3239fb2aa411d826c92faa2f5e171/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:16.210014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac817-1971-40e8-81a3-c605c35d5c6a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.274935 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac817-1971-40e8-81a3-c605c35d5c6a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:16.275915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6feae0-faf5-4629-967c-ab8b57a9a2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:16.276566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6feae0-faf5-4629-967c-ab8b57a9a2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.276837 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6feae0-faf5-4629-967c-ab8b57a9a2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.277119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6feae0-faf5-4629-967c-ab8b57a9a2b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.277796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6feae0-faf5-4629-967c-ab8b57a9a2b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:16.279757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6feae0-faf5-4629-967c-ab8b57a9a2b7 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.351830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 793/1589] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:16 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:16.352660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17811b8-4ef2-4fb3-85f0-f3fc23fadc03 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.362823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17811b8-4ef2-4fb3-85f0-f3fc23fadc03 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:16.367603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610de5-1725-4f00-bf13-eb0c8bfbf400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:16.368195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610de5-1725-4f00-bf13-eb0c8bfbf400 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.368478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610de5-1725-4f00-bf13-eb0c8bfbf400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.368762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610de5-1725-4f00-bf13-eb0c8bfbf400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.369402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4610de5-1725-4f00-bf13-eb0c8bfbf400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:16.371034 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4610de5-1725-4f00-bf13-eb0c8bfbf400 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.380777 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 794/1590] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:16.387398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610de5-1725-4f00-bf13-eb0c8bfbf400 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.391623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610de5-1725-4f00-bf13-eb0c8bfbf400 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:16.396368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f98d98-55dd-4011-840d-9d3c94ad1751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:16.396930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f98d98-55dd-4011-840d-9d3c94ad1751 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.397210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f98d98-55dd-4011-840d-9d3c94ad1751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.397480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f98d98-55dd-4011-840d-9d3c94ad1751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.398145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f98d98-55dd-4011-840d-9d3c94ad1751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:16.399714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f98d98-55dd-4011-840d-9d3c94ad1751 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.409198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 795/1591] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:16.409998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f98d98-55dd-4011-840d-9d3c94ad1751 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.419572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f98d98-55dd-4011-840d-9d3c94ad1751 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:16.424105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd28af4-a980-48c7-a1cf-e34f4834ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:16.424658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd28af4-a980-48c7-a1cf-e34f4834ca00 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.424932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd28af4-a980-48c7-a1cf-e34f4834ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.425201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd28af4-a980-48c7-a1cf-e34f4834ca00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.425840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd28af4-a980-48c7-a1cf-e34f4834ca00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:16.429492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd28af4-a980-48c7-a1cf-e34f4834ca00 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.438634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 796/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:16.439461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd28af4-a980-48c7-a1cf-e34f4834ca00 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.449030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd28af4-a980-48c7-a1cf-e34f4834ca00 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:16.453829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644c82b-49a9-4cf3-ab49-09f36dc9e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:16.458464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644c82b-49a9-4cf3-ab49-09f36dc9e778 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.458464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644c82b-49a9-4cf3-ab49-09f36dc9e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.458464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644c82b-49a9-4cf3-ab49-09f36dc9e778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.458464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644c82b-49a9-4cf3-ab49-09f36dc9e778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:16.458464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644c82b-49a9-4cf3-ab49-09f36dc9e778 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.467019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 797/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:16.467784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644c82b-49a9-4cf3-ab49-09f36dc9e778 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.477308 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644c82b-49a9-4cf3-ab49-09f36dc9e778 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:16.481844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd49ee-5f16-4f03-aee5-16592552c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:16.482404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd49ee-5f16-4f03-aee5-16592552c569 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.482680 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd49ee-5f16-4f03-aee5-16592552c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.482950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd49ee-5f16-4f03-aee5-16592552c569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.483563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd49ee-5f16-4f03-aee5-16592552c569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:16.485085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd49ee-5f16-4f03-aee5-16592552c569 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.495231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 798/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:16.496350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dddf96-8168-48d0-bf89-bc607d53393b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.496635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dddf96-8168-48d0-bf89-bc607d53393b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.496914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dddf96-8168-48d0-bf89-bc607d53393b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.516288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e1dddf96-8168-48d0-bf89-bc607d53393b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:16.516528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e1dddf96-8168-48d0-bf89-bc607d53393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:16.524429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 799/1595] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:16.525279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dddf96-8168-48d0-bf89-bc607d53393b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.534671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dddf96-8168-48d0-bf89-bc607d53393b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:16.539825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b99e2-3121-42b4-a93d-ebb0ccd3f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:16.540417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b99e2-3121-42b4-a93d-ebb0ccd3f099 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.540699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b99e2-3121-42b4-a93d-ebb0ccd3f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.540970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b99e2-3121-42b4-a93d-ebb0ccd3f099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.541608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b99e2-3121-42b4-a93d-ebb0ccd3f099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:16.543210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b99e2-3121-42b4-a93d-ebb0ccd3f099 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.553555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 800/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:16.554346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b99e2-3121-42b4-a93d-ebb0ccd3f099 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.564945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b99e2-3121-42b4-a93d-ebb0ccd3f099 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:16.570310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda97f28-4e83-49fc-9d56-58b3a41c0b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:16.570989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda97f28-4e83-49fc-9d56-58b3a41c0b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.571274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda97f28-4e83-49fc-9d56-58b3a41c0b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.571556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda97f28-4e83-49fc-9d56-58b3a41c0b33 admin admin] PATH_INFO: `/v3/projects/0324975199494d4a8278e4b9438e78ef/users/6773bc20a0d740e588f1858e5e9b1d11/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.586765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda97f28-4e83-49fc-9d56-58b3a41c0b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0324975199494d4a8278e4b9438e78ef, user_id=6773bc20a0d740e588f1858e5e9b1d11, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:16.587790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WARNING py.warnings [None req-fda97f28-4e83-49fc-9d56-58b3a41c0b33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:28:16.587790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: warnings.warn(msg) Aug 31 19:28:16.587790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: Aug 31 19:28:16.589812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda97f28-4e83-49fc-9d56-58b3a41c0b33 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.654185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 797/1597] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:16 2022] POST /identity/v3/users => generated 293 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:16.654185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6feae0-faf5-4629-967c-ab8b57a9a2b7 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.659472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6feae0-faf5-4629-967c-ab8b57a9a2b7 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:16.665633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb4e92-5285-430c-9dfd-10912a9c0cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:16.666322 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb4e92-5285-430c-9dfd-10912a9c0cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:16.666603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb4e92-5285-430c-9dfd-10912a9c0cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:16.666881 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb4e92-5285-430c-9dfd-10912a9c0cc8 admin admin] PATH_INFO: `/v3/projects/bec96ba42442479ab53f5d00ac8f1ccd/users/fb4ecdfb04cb435a9569e84080a236e2/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:16.681435 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb4e92-5285-430c-9dfd-10912a9c0cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec96ba42442479ab53f5d00ac8f1ccd, user_id=fb4ecdfb04cb435a9569e84080a236e2, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:16.684105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb4e92-5285-430c-9dfd-10912a9c0cc8 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:16.911183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 801/1598] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:16 2022] PUT /identity/v3/projects/0324975199494d4a8278e4b9438e78ef/users/6773bc20a0d740e588f1858e5e9b1d11/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:16.912540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda97f28-4e83-49fc-9d56-58b3a41c0b33 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.966363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 798/1599] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:16 2022] PUT /identity/v3/projects/bec96ba42442479ab53f5d00ac8f1ccd/users/fb4ecdfb04cb435a9569e84080a236e2/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:16.967301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb4e92-5285-430c-9dfd-10912a9c0cc8 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:16.976511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda97f28-4e83-49fc-9d56-58b3a41c0b33 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.031194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb4e92-5285-430c-9dfd-10912a9c0cc8 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.034753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05f3cc-9bab-473a-912b-54d52b78694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.035376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05f3cc-9bab-473a-912b-54d52b78694d admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.035658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05f3cc-9bab-473a-912b-54d52b78694d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.035903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69feaa-80d7-45d6-a062-636bbccf1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.036079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05f3cc-9bab-473a-912b-54d52b78694d admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.036521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69feaa-80d7-45d6-a062-636bbccf1cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.036635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05f3cc-9bab-473a-912b-54d52b78694d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.036809 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69feaa-80d7-45d6-a062-636bbccf1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.037081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69feaa-80d7-45d6-a062-636bbccf1cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.037767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69feaa-80d7-45d6-a062-636bbccf1cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.038240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05f3cc-9bab-473a-912b-54d52b78694d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.039364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69feaa-80d7-45d6-a062-636bbccf1cd1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.050233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 802/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:17.051063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05f3cc-9bab-473a-912b-54d52b78694d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.051203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 799/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:17.052049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69feaa-80d7-45d6-a062-636bbccf1cd1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.064825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05f3cc-9bab-473a-912b-54d52b78694d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.070659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64170d1-20bc-41f9-9098-64c1e81ac20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.071283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64170d1-20bc-41f9-9098-64c1e81ac20a admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.071539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64170d1-20bc-41f9-9098-64c1e81ac20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.071812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64170d1-20bc-41f9-9098-64c1e81ac20a admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.072454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64170d1-20bc-41f9-9098-64c1e81ac20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.074067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64170d1-20bc-41f9-9098-64c1e81ac20a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.089088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 803/1602] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:17.089088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64170d1-20bc-41f9-9098-64c1e81ac20a admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.096067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64170d1-20bc-41f9-9098-64c1e81ac20a admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.105743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f876-7f94-4dc7-abfb-955e4e7a843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.136397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f876-7f94-4dc7-abfb-955e4e7a843f admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.136397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f876-7f94-4dc7-abfb-955e4e7a843f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.136397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f876-7f94-4dc7-abfb-955e4e7a843f admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.136397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079f876-7f94-4dc7-abfb-955e4e7a843f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.136397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079f876-7f94-4dc7-abfb-955e4e7a843f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.136948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69feaa-80d7-45d6-a062-636bbccf1cd1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.136948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479192a-5a54-44ab-b1b5-d3d24edadbf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.136948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479192a-5a54-44ab-b1b5-d3d24edadbf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.136948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479192a-5a54-44ab-b1b5-d3d24edadbf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.137266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479192a-5a54-44ab-b1b5-d3d24edadbf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.137357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 804/1603] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:17.137357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f876-7f94-4dc7-abfb-955e4e7a843f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.137512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479192a-5a54-44ab-b1b5-d3d24edadbf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.137512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479192a-5a54-44ab-b1b5-d3d24edadbf3 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.137692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f876-7f94-4dc7-abfb-955e4e7a843f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.137692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88f45d-f385-4634-9753-8c31c70b0025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.137692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88f45d-f385-4634-9753-8c31c70b0025 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.137692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88f45d-f385-4634-9753-8c31c70b0025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.137989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88f45d-f385-4634-9753-8c31c70b0025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.138782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88f45d-f385-4634-9753-8c31c70b0025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.140109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 800/1604] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:17.140379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88f45d-f385-4634-9753-8c31c70b0025 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.141449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c22c2-778f-404a-8920-ba6967fe77ba None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.141838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c22c2-778f-404a-8920-ba6967fe77ba None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.142083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c22c2-778f-404a-8920-ba6967fe77ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.152173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 805/1605] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:17.153638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2c7b1-8089-484f-99bf-70df2c60a269 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.154006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2c7b1-8089-484f-99bf-70df2c60a269 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.154347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2c7b1-8089-484f-99bf-70df2c60a269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.163616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-2b4c22c2-778f-404a-8920-ba6967fe77ba None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:17.164826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2b4c22c2-778f-404a-8920-ba6967fe77ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:17.173767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 801/1606] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:17.177128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c22c2-778f-404a-8920-ba6967fe77ba None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.177253 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-7af2c7b1-8089-484f-99bf-70df2c60a269 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:17.178140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7af2c7b1-8089-484f-99bf-70df2c60a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:17.184822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c22c2-778f-404a-8920-ba6967fe77ba None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.185906 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 806/1607] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:17.186722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2c7b1-8089-484f-99bf-70df2c60a269 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.193536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb1e3f-7b7c-4ac2-9841-264c8eeb14fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.194432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb1e3f-7b7c-4ac2-9841-264c8eeb14fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.194788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb1e3f-7b7c-4ac2-9841-264c8eeb14fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.195071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb1e3f-7b7c-4ac2-9841-264c8eeb14fc admin admin] PATH_INFO: `/v3/projects/49a52a616fa346aab45a3c60ac2b665f/users/74a0a587ca4b460494757ad7951a5467/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.197209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2c7b1-8089-484f-99bf-70df2c60a269 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.201843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41765c7-3ca0-4b71-89f1-2517eb840b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.202437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41765c7-3ca0-4b71-89f1-2517eb840b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.202714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41765c7-3ca0-4b71-89f1-2517eb840b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.202984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41765c7-3ca0-4b71-89f1-2517eb840b1e admin admin] PATH_INFO: `/v3/projects/03ff639ad8cc47ae952f8ffd97d6be34/users/b3700845fb13491ebae9277b33c00113/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.212360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb1e3f-7b7c-4ac2-9841-264c8eeb14fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a52a616fa346aab45a3c60ac2b665f, user_id=74a0a587ca4b460494757ad7951a5467, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.215086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb1e3f-7b7c-4ac2-9841-264c8eeb14fc admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.219153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41765c7-3ca0-4b71-89f1-2517eb840b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ff639ad8cc47ae952f8ffd97d6be34, user_id=b3700845fb13491ebae9277b33c00113, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.221868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41765c7-3ca0-4b71-89f1-2517eb840b1e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.385186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 802/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:17 2022] PUT /identity/v3/projects/49a52a616fa346aab45a3c60ac2b665f/users/74a0a587ca4b460494757ad7951a5467/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:17.386069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb1e3f-7b7c-4ac2-9841-264c8eeb14fc admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.387139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 807/1609] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:17 2022] PUT /identity/v3/projects/03ff639ad8cc47ae952f8ffd97d6be34/users/b3700845fb13491ebae9277b33c00113/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:17.388743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41765c7-3ca0-4b71-89f1-2517eb840b1e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.455897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:17.468938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb1e3f-7b7c-4ac2-9841-264c8eeb14fc admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.469849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41765c7-3ca0-4b71-89f1-2517eb840b1e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.475856 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe5eec-7ef3-4fd3-a02c-6fc0b4c0c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.476618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe5eec-7ef3-4fd3-a02c-6fc0b4c0c83f admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.476887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33f407-b09a-4a60-804d-63e4d55b80bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.477193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe5eec-7ef3-4fd3-a02c-6fc0b4c0c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.477539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe5eec-7ef3-4fd3-a02c-6fc0b4c0c83f admin admin] PATH_INFO: `/v3/projects/27e49665175245a8b2297ad078ab76ba/users/27d710f7757e427fbf3921ab488b0ed1/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.477658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33f407-b09a-4a60-804d-63e4d55b80bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.477935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33f407-b09a-4a60-804d-63e4d55b80bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.478213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33f407-b09a-4a60-804d-63e4d55b80bf admin admin] PATH_INFO: `/v3/projects/f1e9c18961614bf0aa3099dc9e4a635b/users/196133ded5d647e99c68a329d786f71c/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.494541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe5eec-7ef3-4fd3-a02c-6fc0b4c0c83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e49665175245a8b2297ad078ab76ba, user_id=27d710f7757e427fbf3921ab488b0ed1, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.497288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe5eec-7ef3-4fd3-a02c-6fc0b4c0c83f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.554518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33f407-b09a-4a60-804d-63e4d55b80bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e9c18961614bf0aa3099dc9e4a635b, user_id=196133ded5d647e99c68a329d786f71c, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.557390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33f407-b09a-4a60-804d-63e4d55b80bf admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.639148 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:17.733703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 808/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:17 2022] PUT /identity/v3/projects/f1e9c18961614bf0aa3099dc9e4a635b/users/196133ded5d647e99c68a329d786f71c/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:17.733879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 803/1611] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:17 2022] PUT /identity/v3/projects/27e49665175245a8b2297ad078ab76ba/users/27d710f7757e427fbf3921ab488b0ed1/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:17.734329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33f407-b09a-4a60-804d-63e4d55b80bf admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.734411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe5eec-7ef3-4fd3-a02c-6fc0b4c0c83f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.810726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33f407-b09a-4a60-804d-63e4d55b80bf admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.819052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe5eec-7ef3-4fd3-a02c-6fc0b4c0c83f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.842118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65817d44-dfc6-4360-b957-ba884b177a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.842118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817d44-dfc6-4360-b957-ba884b177a0d service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.842118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817d44-dfc6-4360-b957-ba884b177a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.842118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817d44-dfc6-4360-b957-ba884b177a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.878596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433e7db-86b9-41ac-bec7-4df91bf64693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.879215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433e7db-86b9-41ac-bec7-4df91bf64693 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.879494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433e7db-86b9-41ac-bec7-4df91bf64693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.880290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433e7db-86b9-41ac-bec7-4df91bf64693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.880959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433e7db-86b9-41ac-bec7-4df91bf64693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.882616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433e7db-86b9-41ac-bec7-4df91bf64693 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.892315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65817d44-dfc6-4360-b957-ba884b177a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.893869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65817d44-dfc6-4360-b957-ba884b177a0d service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.896568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 809/1612] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:17.897608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433e7db-86b9-41ac-bec7-4df91bf64693 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:17.904368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 804/1613] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:17.905794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a744aa-d5da-463d-b6ea-175bee0816a7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.906101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a744aa-d5da-463d-b6ea-175bee0816a7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.906318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a744aa-d5da-463d-b6ea-175bee0816a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.907056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433e7db-86b9-41ac-bec7-4df91bf64693 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:17.910757 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bb729-3dff-4543-848d-7038f8619b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:17.911388 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bb729-3dff-4543-848d-7038f8619b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.911669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bb729-3dff-4543-848d-7038f8619b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.911947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bb729-3dff-4543-848d-7038f8619b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.921704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bb729-3dff-4543-848d-7038f8619b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:17.923272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bb729-3dff-4543-848d-7038f8619b35 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:17.933921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-66a744aa-d5da-463d-b6ea-175bee0816a7 None None] MFA Rules not processed for user `b3700845fb13491ebae9277b33c00113`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:17.934584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 810/1614] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:17.935160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-66a744aa-d5da-463d-b6ea-175bee0816a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:17.936081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0c27-f6ed-4cda-a7fc-883e7f385006 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:17.936669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0c27-f6ed-4cda-a7fc-883e7f385006 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:17.936951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f0c27-f6ed-4cda-a7fc-883e7f385006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:17.969292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-731f0c27-f6ed-4cda-a7fc-883e7f385006 None None] MFA Rules not processed for user `74a0a587ca4b460494757ad7951a5467`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:17.970584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-731f0c27-f6ed-4cda-a7fc-883e7f385006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:18.003034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 805/1615] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:18.004298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23abf81-29d8-4f32-b5a9-6a8861915df7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.004587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23abf81-29d8-4f32-b5a9-6a8861915df7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.005412 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23abf81-29d8-4f32-b5a9-6a8861915df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.033655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e23abf81-29d8-4f32-b5a9-6a8861915df7 None None] MFA Rules not processed for user `196133ded5d647e99c68a329d786f71c`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:18.034901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e23abf81-29d8-4f32-b5a9-6a8861915df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:18.037464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 811/1616] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:18.038747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2c26-b726-4ee8-92eb-dc89f2d6d009 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.039094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2c26-b726-4ee8-92eb-dc89f2d6d009 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.039300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d2c26-b726-4ee8-92eb-dc89f2d6d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.058136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9d0d2c26-b726-4ee8-92eb-dc89f2d6d009 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:18.059345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9d0d2c26-b726-4ee8-92eb-dc89f2d6d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:18.067147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 812/1617] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:18.071584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d2c26-b726-4ee8-92eb-dc89f2d6d009 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:18.081468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d2c26-b726-4ee8-92eb-dc89f2d6d009 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:18.086514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53db278-13ad-4be0-8ae3-d86f2384c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:18.087175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53db278-13ad-4be0-8ae3-d86f2384c43a admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.087456 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53db278-13ad-4be0-8ae3-d86f2384c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.087730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53db278-13ad-4be0-8ae3-d86f2384c43a admin admin] PATH_INFO: `/v3/projects/b8797d7171d4455f8bf8392c24003bf2/users/9b0a09141e3748359837fed83f0eff98/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.103445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53db278-13ad-4be0-8ae3-d86f2384c43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8797d7171d4455f8bf8392c24003bf2, user_id=9b0a09141e3748359837fed83f0eff98, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:18.106516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53db278-13ad-4be0-8ae3-d86f2384c43a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:18.111769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 806/1618] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:18.128419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23abf81-29d8-4f32-b5a9-6a8861915df7 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:18.128419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23abf81-29d8-4f32-b5a9-6a8861915df7 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:18.131148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda2b84-26a4-4a4a-b240-e737f6430cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:18.131772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda2b84-26a4-4a4a-b240-e737f6430cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.132162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda2b84-26a4-4a4a-b240-e737f6430cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.132315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda2b84-26a4-4a4a-b240-e737f6430cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.132977 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda2b84-26a4-4a4a-b240-e737f6430cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:18.134909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda2b84-26a4-4a4a-b240-e737f6430cbc admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:18.358882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 813/1619] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:18 2022] PUT /identity/v3/projects/b8797d7171d4455f8bf8392c24003bf2/users/9b0a09141e3748359837fed83f0eff98/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:18.360892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373ba3e-6e57-42d0-bc87-15164131ed01 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.361281 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373ba3e-6e57-42d0-bc87-15164131ed01 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.369061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373ba3e-6e57-42d0-bc87-15164131ed01 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.369269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 807/1620] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:18 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:18.369269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda2b84-26a4-4a4a-b240-e737f6430cbc admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:18.371866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 814/1621] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 31 19:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:28:18.374118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd747d6-a3f4-41af-9b75-42fc1b0b1533 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.374586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd747d6-a3f4-41af-9b75-42fc1b0b1533 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.374955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd747d6-a3f4-41af-9b75-42fc1b0b1533 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.378177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 815/1622] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 31 19:28:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:28:18.381934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204d7c1-3dd6-4b19-945b-abf03f54ee43 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.381934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204d7c1-3dd6-4b19-945b-abf03f54ee43 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.383908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204d7c1-3dd6-4b19-945b-abf03f54ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.418699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-d204d7c1-3dd6-4b19-945b-abf03f54ee43 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:18.420107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d204d7c1-3dd6-4b19-945b-abf03f54ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:18.437566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:18.458199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda2b84-26a4-4a4a-b240-e737f6430cbc admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:18.466099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74816f37-e55b-43a4-ad5a-65d09987fc19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:18.466099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816f37-e55b-43a4-ad5a-65d09987fc19 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.466099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816f37-e55b-43a4-ad5a-65d09987fc19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.466099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816f37-e55b-43a4-ad5a-65d09987fc19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.489848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 816/1623] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:18.491037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204d7c1-3dd6-4b19-945b-abf03f54ee43 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:18.506426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204d7c1-3dd6-4b19-945b-abf03f54ee43 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:18.511375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08939d40-12e8-41bd-a509-0d92dd1f6cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:18.512062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08939d40-12e8-41bd-a509-0d92dd1f6cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.512386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08939d40-12e8-41bd-a509-0d92dd1f6cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.512692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08939d40-12e8-41bd-a509-0d92dd1f6cdb admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.513340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08939d40-12e8-41bd-a509-0d92dd1f6cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:18.515444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08939d40-12e8-41bd-a509-0d92dd1f6cdb admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:18.526785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74816f37-e55b-43a4-ad5a-65d09987fc19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:18.553746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74816f37-e55b-43a4-ad5a-65d09987fc19 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:18.553746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 808/1624] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:18.553746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e35e3-c7ed-4ab7-935e-aaaf4dbe5ba8 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.553746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e35e3-c7ed-4ab7-935e-aaaf4dbe5ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.553746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e35e3-c7ed-4ab7-935e-aaaf4dbe5ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.579891 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-299e35e3-c7ed-4ab7-935e-aaaf4dbe5ba8 None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:18.581351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-299e35e3-c7ed-4ab7-935e-aaaf4dbe5ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:18.646297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 809/1625] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 31 19:28:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:18.647550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d2d9a-9155-48c6-8a02-8675b28e75d2 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.647836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d2d9a-9155-48c6-8a02-8675b28e75d2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.648244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d2d9a-9155-48c6-8a02-8675b28e75d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.669032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9b2d2d9a-9155-48c6-8a02-8675b28e75d2 None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:18.670272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9b2d2d9a-9155-48c6-8a02-8675b28e75d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:18.680719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 810/1626] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 31 19:28:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:18.681507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d2d9a-9155-48c6-8a02-8675b28e75d2 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:18.690527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d2d9a-9155-48c6-8a02-8675b28e75d2 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:18.694147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b5f91-f0e8-4f2a-a450-569f7d4d00df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:18.694730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b5f91-f0e8-4f2a-a450-569f7d4d00df service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.695068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b5f91-f0e8-4f2a-a450-569f7d4d00df service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.695372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b5f91-f0e8-4f2a-a450-569f7d4d00df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.707246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b5f91-f0e8-4f2a-a450-569f7d4d00df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:18.708685 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b5f91-f0e8-4f2a-a450-569f7d4d00df service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:18.726253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 811/1627] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:18.726253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b5f91-f0e8-4f2a-a450-569f7d4d00df service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:18.731212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b5f91-f0e8-4f2a-a450-569f7d4d00df service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:18.736730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23b96b-df8c-41a6-9a0c-a1bef938f591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:18.737397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23b96b-df8c-41a6-9a0c-a1bef938f591 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.737602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23b96b-df8c-41a6-9a0c-a1bef938f591 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.737943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23b96b-df8c-41a6-9a0c-a1bef938f591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.803527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23b96b-df8c-41a6-9a0c-a1bef938f591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:18.805240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23b96b-df8c-41a6-9a0c-a1bef938f591 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:18.818904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 812/1628] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:18.819782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23b96b-df8c-41a6-9a0c-a1bef938f591 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:18.831636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23b96b-df8c-41a6-9a0c-a1bef938f591 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:18.838676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb3d1-16c2-47ae-bf89-d78132337c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:18.839641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb3d1-16c2-47ae-bf89-d78132337c96 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.840202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb3d1-16c2-47ae-bf89-d78132337c96 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.840747 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb3d1-16c2-47ae-bf89-d78132337c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.902241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fb3d1-16c2-47ae-bf89-d78132337c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:18.903983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fb3d1-16c2-47ae-bf89-d78132337c96 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:18.914651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 813/1629] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:18.954635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 817/1630] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:18 2022] POST /identity/v3/users => generated 294 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:18.971915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb3d1-16c2-47ae-bf89-d78132337c96 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:18.974199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb3d1-16c2-47ae-bf89-d78132337c96 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:18.981114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675a377-d7ef-4387-99c9-04f7b9ca0ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:18.982045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675a377-d7ef-4387-99c9-04f7b9ca0ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:18.983002 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675a377-d7ef-4387-99c9-04f7b9ca0ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:18.983374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675a377-d7ef-4387-99c9-04f7b9ca0ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:18.984866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675a377-d7ef-4387-99c9-04f7b9ca0ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:18.986840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675a377-d7ef-4387-99c9-04f7b9ca0ae6 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:19.017471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 814/1631] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:28:19.021952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08939d40-12e8-41bd-a509-0d92dd1f6cdb admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:19.044424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08939d40-12e8-41bd-a509-0d92dd1f6cdb admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:19.054420 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176699ea-d878-4383-b118-27ce69d734f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:19.055833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176699ea-d878-4383-b118-27ce69d734f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:19.056313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176699ea-d878-4383-b118-27ce69d734f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:19.057141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176699ea-d878-4383-b118-27ce69d734f5 admin admin] PATH_INFO: `/v3/projects/b6e9f318c9314c51bbf6f9cd623b79d5/users/78e7d42c62b74daa83fee1cff8a43e4e/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:19.080878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176699ea-d878-4383-b118-27ce69d734f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e9f318c9314c51bbf6f9cd623b79d5, user_id=78e7d42c62b74daa83fee1cff8a43e4e, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:19.086722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176699ea-d878-4383-b118-27ce69d734f5 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:19.120745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54000a64-ebfc-4c13-8bdf-fcd7253aceb6 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:19.121030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54000a64-ebfc-4c13-8bdf-fcd7253aceb6 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:19.121324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54000a64-ebfc-4c13-8bdf-fcd7253aceb6 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:19.122962 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 815/1632] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 31 19:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:28:19.128040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3506c-6ee7-4ea5-8a6e-a41cb7b1547f None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:19.128430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3506c-6ee7-4ea5-8a6e-a41cb7b1547f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:19.128958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3506c-6ee7-4ea5-8a6e-a41cb7b1547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:19.171277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-cde3506c-6ee7-4ea5-8a6e-a41cb7b1547f None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:19.173358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-cde3506c-6ee7-4ea5-8a6e-a41cb7b1547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:19.191009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 816/1633] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:19.193219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076747d-1f18-48c7-9d96-72517418c873 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:19.199400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076747d-1f18-48c7-9d96-72517418c873 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:19.199400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076747d-1f18-48c7-9d96-72517418c873 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:19.199400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 817/1634] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 31 19:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:28:19.200638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b920-00d0-43e8-84f0-ef679eb48540 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:19.200922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b920-00d0-43e8-84f0-ef679eb48540 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:19.201587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b920-00d0-43e8-84f0-ef679eb48540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:19.222256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-34c9b920-00d0-43e8-84f0-ef679eb48540 None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:19.223288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-34c9b920-00d0-43e8-84f0-ef679eb48540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:19.235609 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 818/1635] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:19.238602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9b920-00d0-43e8-84f0-ef679eb48540 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:19.296083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9b920-00d0-43e8-84f0-ef679eb48540 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:19.299827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c16fd4-8ff2-4595-9bc1-50b28708d1c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:19.300506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16fd4-8ff2-4595-9bc1-50b28708d1c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:19.300853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16fd4-8ff2-4595-9bc1-50b28708d1c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:19.301200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16fd4-8ff2-4595-9bc1-50b28708d1c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:19.311955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c16fd4-8ff2-4595-9bc1-50b28708d1c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:19.313323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c16fd4-8ff2-4595-9bc1-50b28708d1c3 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:19.325029 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 819/1636] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:19.325888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c16fd4-8ff2-4595-9bc1-50b28708d1c3 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:19.335104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c16fd4-8ff2-4595-9bc1-50b28708d1c3 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:19.349079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 818/1637] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:19 2022] PUT /identity/v3/projects/b6e9f318c9314c51bbf6f9cd623b79d5/users/78e7d42c62b74daa83fee1cff8a43e4e/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:28:19.355084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176699ea-d878-4383-b118-27ce69d734f5 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:19.409839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8c3d2-0a84-4dd2-83c2-3b308dd42d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:19.410733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8c3d2-0a84-4dd2-83c2-3b308dd42d58 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:19.411099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8c3d2-0a84-4dd2-83c2-3b308dd42d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:19.411377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8c3d2-0a84-4dd2-83c2-3b308dd42d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:19.477762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176699ea-d878-4383-b118-27ce69d734f5 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:19.484304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e25c-0db2-46f0-8cef-d83ad19be029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:19.485072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e25c-0db2-46f0-8cef-d83ad19be029 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:19.485441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e25c-0db2-46f0-8cef-d83ad19be029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:19.485866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e25c-0db2-46f0-8cef-d83ad19be029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:19.486815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6e25c-0db2-46f0-8cef-d83ad19be029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:19.488534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6e25c-0db2-46f0-8cef-d83ad19be029 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:19.521690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 819/1638] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:19.523699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e25c-0db2-46f0-8cef-d83ad19be029 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:19.551447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e25c-0db2-46f0-8cef-d83ad19be029 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:19.566240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695e5a6-5a0a-4b32-b886-5d9023720fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:19.568116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695e5a6-5a0a-4b32-b886-5d9023720fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:19.568398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695e5a6-5a0a-4b32-b886-5d9023720fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:19.568724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695e5a6-5a0a-4b32-b886-5d9023720fd9 admin admin] PATH_INFO: `/v3/projects/b6e9f318c9314c51bbf6f9cd623b79d5/users/78e7d42c62b74daa83fee1cff8a43e4e/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:19.575382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695e5a6-5a0a-4b32-b886-5d9023720fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e9f318c9314c51bbf6f9cd623b79d5, user_id=78e7d42c62b74daa83fee1cff8a43e4e, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:19.577974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8c3d2-0a84-4dd2-83c2-3b308dd42d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:19.578887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695e5a6-5a0a-4b32-b886-5d9023720fd9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:19.579570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8c3d2-0a84-4dd2-83c2-3b308dd42d58 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:20.358435 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 820/1639] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:20.361134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 820/1640] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:19 2022] PUT /identity/v3/projects/b6e9f318c9314c51bbf6f9cd623b79d5/users/78e7d42c62b74daa83fee1cff8a43e4e/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:20.361839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d95d7-c6d3-485a-b5ba-7d2b4b77279f None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:20.361839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d95d7-c6d3-485a-b5ba-7d2b4b77279f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:20.361839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d95d7-c6d3-485a-b5ba-7d2b4b77279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:20.361839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-cb3d95d7-c6d3-485a-b5ba-7d2b4b77279f None None] MFA Rules not processed for user `78e7d42c62b74daa83fee1cff8a43e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:20.361839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-cb3d95d7-c6d3-485a-b5ba-7d2b4b77279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:20.361839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 821/1641] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:20.363444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0721-591a-46e0-8764-2848da1963a0 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:20.363444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0721-591a-46e0-8764-2848da1963a0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:20.363444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0721-591a-46e0-8764-2848da1963a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:20.363444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-d6db0721-591a-46e0-8764-2848da1963a0 None None] MFA Rules not processed for user `8af3239fb2aa411d826c92faa2f5e171`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:20.363444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d6db0721-591a-46e0-8764-2848da1963a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:20.400345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 821/1642] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:20.405190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d95d7-c6d3-485a-b5ba-7d2b4b77279f None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:20.475774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d95d7-c6d3-485a-b5ba-7d2b4b77279f None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:20.481290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957888dc-6ce3-450a-8497-a4e6e4b541d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:20.481936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957888dc-6ce3-450a-8497-a4e6e4b541d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:20.482210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957888dc-6ce3-450a-8497-a4e6e4b541d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:20.497074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957888dc-6ce3-450a-8497-a4e6e4b541d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:20.497074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957888dc-6ce3-450a-8497-a4e6e4b541d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:20.497074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957888dc-6ce3-450a-8497-a4e6e4b541d6 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:20.848014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 822/1643] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:20 2022] POST /identity/v3/projects => generated 403 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:20.848265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db0721-591a-46e0-8764-2848da1963a0 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:20.861602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db0721-591a-46e0-8764-2848da1963a0 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:20.940587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea49e4-c2ae-4d07-b9db-826b03b8cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:20.941359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea49e4-c2ae-4d07-b9db-826b03b8cc1e admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:20.941856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea49e4-c2ae-4d07-b9db-826b03b8cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:20.942826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea49e4-c2ae-4d07-b9db-826b03b8cc1e admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:20.943736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea49e4-c2ae-4d07-b9db-826b03b8cc1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:20.945910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea49e4-c2ae-4d07-b9db-826b03b8cc1e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:21.046400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:21.177922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 822/1644] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:20 2022] POST /identity/v3/users => generated 308 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:21.184217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957888dc-6ce3-450a-8497-a4e6e4b541d6 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:21.205642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957888dc-6ce3-450a-8497-a4e6e4b541d6 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:21.210296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ddaa7-f086-416d-b453-e837907c0394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:21.210924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ddaa7-f086-416d-b453-e837907c0394 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:21.211240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ddaa7-f086-416d-b453-e837907c0394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:21.211481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ddaa7-f086-416d-b453-e837907c0394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:21.212143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ddaa7-f086-416d-b453-e837907c0394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:21.213835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ddaa7-f086-416d-b453-e837907c0394 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:21.225129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 823/1645] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:21.229728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea49e4-c2ae-4d07-b9db-826b03b8cc1e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:21.252724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea49e4-c2ae-4d07-b9db-826b03b8cc1e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:21.265088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815fbc0-4f14-41cd-8776-88bb5a0695bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:21.266264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815fbc0-4f14-41cd-8776-88bb5a0695bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:21.266264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815fbc0-4f14-41cd-8776-88bb5a0695bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:21.266520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815fbc0-4f14-41cd-8776-88bb5a0695bb admin admin] PATH_INFO: `/v3/projects/bd082a082dc940c78a9b6eed1fa24726/users/98141f2708ae4eb6b7fa8db58f7bbf18/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:21.302205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815fbc0-4f14-41cd-8776-88bb5a0695bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd082a082dc940c78a9b6eed1fa24726, user_id=98141f2708ae4eb6b7fa8db58f7bbf18, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:21.305547 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815fbc0-4f14-41cd-8776-88bb5a0695bb admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:21.449839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ddaa7-f086-416d-b453-e837907c0394 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:21.465361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 823/1646] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:21 2022] PUT /identity/v3/projects/bd082a082dc940c78a9b6eed1fa24726/users/98141f2708ae4eb6b7fa8db58f7bbf18/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:21.468150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815fbc0-4f14-41cd-8776-88bb5a0695bb admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:21.523234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ddaa7-f086-416d-b453-e837907c0394 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:21.535927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815fbc0-4f14-41cd-8776-88bb5a0695bb admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:21.541501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddc558-392a-4c60-a2e8-8b9115678893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:21.542191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddc558-392a-4c60-a2e8-8b9115678893 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:21.568474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddc558-392a-4c60-a2e8-8b9115678893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:21.568474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddc558-392a-4c60-a2e8-8b9115678893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:21.568474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddc558-392a-4c60-a2e8-8b9115678893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:21.568474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddc558-392a-4c60-a2e8-8b9115678893 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:21.568474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 824/1647] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:28:21.571756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddc558-392a-4c60-a2e8-8b9115678893 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:21.582944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddc558-392a-4c60-a2e8-8b9115678893 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:21.588758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e20c74-5020-4cde-8c2f-d02412586a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:21.589566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20c74-5020-4cde-8c2f-d02412586a84 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:21.589987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20c74-5020-4cde-8c2f-d02412586a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:21.590272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20c74-5020-4cde-8c2f-d02412586a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:21.590467 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570266ad-89bc-44b7-8adc-46de1e851427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:21.591220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570266ad-89bc-44b7-8adc-46de1e851427 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:21.591565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570266ad-89bc-44b7-8adc-46de1e851427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:21.591926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570266ad-89bc-44b7-8adc-46de1e851427 admin admin] PATH_INFO: `/v3/projects/bd082a082dc940c78a9b6eed1fa24726/users/98141f2708ae4eb6b7fa8db58f7bbf18/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:21.594053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570266ad-89bc-44b7-8adc-46de1e851427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd082a082dc940c78a9b6eed1fa24726, user_id=98141f2708ae4eb6b7fa8db58f7bbf18, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:21.596832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570266ad-89bc-44b7-8adc-46de1e851427 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:21.616501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 825/1648] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:21 2022] PUT /identity/v3/projects/bd082a082dc940c78a9b6eed1fa24726/users/98141f2708ae4eb6b7fa8db58f7bbf18/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:28:21.668656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e20c74-5020-4cde-8c2f-d02412586a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:21.670426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e20c74-5020-4cde-8c2f-d02412586a84 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:21.682862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 824/1649] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:28:22.455730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:23.345480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:25.136922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989433f-2a73-40c3-b144-98257e54a603 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:25.137572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989433f-2a73-40c3-b144-98257e54a603 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:25.137842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989433f-2a73-40c3-b144-98257e54a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:25.220422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c989433f-2a73-40c3-b144-98257e54a603 None None] MFA Rules not processed for user `98141f2708ae4eb6b7fa8db58f7bbf18`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:25.222295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c989433f-2a73-40c3-b144-98257e54a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:25.371927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:25.456035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 826/1650] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:26.047244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e20c74-5020-4cde-8c2f-d02412586a84 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:26.063087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e20c74-5020-4cde-8c2f-d02412586a84 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:26.205997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:26.207542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:26.208714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:26.209775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] PATH_INFO: `/v3/users/196133ded5d647e99c68a329d786f71c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:26.211442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196133ded5d647e99c68a329d786f71c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:26.214491 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:26.566843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:26.603801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196133ded5d647e99c68a329d786f71c'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:26.710705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196133ded5d647e99c68a329d786f71c'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:26.711781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196133ded5d647e99c68a329d786f71c'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:26.731318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196133ded5d647e99c68a329d786f71c'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:26.739108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196133ded5d647e99c68a329d786f71c'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:26.773036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 825/1651] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:28:26 2022] DELETE /identity/v3/users/196133ded5d647e99c68a329d786f71c => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:26.777856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1589-0d8e-40be-bbb6-05546d451a5e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:26.778392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1589-0d8e-40be-bbb6-05546d451a5e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:26.778811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1589-0d8e-40be-bbb6-05546d451a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:26.840661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-590b1589-0d8e-40be-bbb6-05546d451a5e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:26.842733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-590b1589-0d8e-40be-bbb6-05546d451a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:26.998818 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 827/1652] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:27.036729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:27.039332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:27.169103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ebd93-9d3d-4e04-a5a8-588774ee0367 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:27.178505 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ca492-9eaa-4c41-b30f-7e8b40079911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:27.179763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ca492-9eaa-4c41-b30f-7e8b40079911 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:27.180302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ca492-9eaa-4c41-b30f-7e8b40079911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:27.180665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ca492-9eaa-4c41-b30f-7e8b40079911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:27.205008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ca492-9eaa-4c41-b30f-7e8b40079911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:27.207105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ca492-9eaa-4c41-b30f-7e8b40079911 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:27.227997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 826/1653] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:27.675850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0eaa5-8d07-41de-94f6-83b0cfc28c17 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:27.678951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0eaa5-8d07-41de-94f6-83b0cfc28c17 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:27.678951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0eaa5-8d07-41de-94f6-83b0cfc28c17 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:27.678951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 828/1654] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:28:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:28:27.691023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379d84f-6faa-47a5-9a1d-4e4fcc790ab1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:27.691570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379d84f-6faa-47a5-9a1d-4e4fcc790ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:27.691873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379d84f-6faa-47a5-9a1d-4e4fcc790ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:27.722522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-f379d84f-6faa-47a5-9a1d-4e4fcc790ab1 None None] MFA Rules not processed for user `b98cb3da3efe49acbfe640366bf7b53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:27.724753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f379d84f-6faa-47a5-9a1d-4e4fcc790ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:27.877291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 827/1655] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:28:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:27.907592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0eaa5-8d07-41de-94f6-83b0cfc28c17 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:27.910048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8da0eaa5-8d07-41de-94f6-83b0cfc28c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:27.917091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:27.952748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0eaa5-8d07-41de-94f6-83b0cfc28c17 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:27.965930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec9c0-c0f1-4d68-b025-ecfa1339db6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:27.966567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec9c0-c0f1-4d68-b025-ecfa1339db6c service placement] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:27.966926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec9c0-c0f1-4d68-b025-ecfa1339db6c service placement] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:27.967229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec9c0-c0f1-4d68-b025-ecfa1339db6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:27.987446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec9c0-c0f1-4d68-b025-ecfa1339db6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:27.989195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec9c0-c0f1-4d68-b025-ecfa1339db6c service placement] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:28.023053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 829/1656] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:28.537767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379d84f-6faa-47a5-9a1d-4e4fcc790ab1 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:28.539870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f379d84f-6faa-47a5-9a1d-4e4fcc790ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:28.671782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379d84f-6faa-47a5-9a1d-4e4fcc790ab1 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:28.685849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a17f4-3603-4614-a7b2-835ec1ad5d4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:28.685849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a17f4-3603-4614-a7b2-835ec1ad5d4b service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:28.685849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a17f4-3603-4614-a7b2-835ec1ad5d4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:28.685849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a17f4-3603-4614-a7b2-835ec1ad5d4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:28.686228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f18a17f4-3603-4614-a7b2-835ec1ad5d4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:28.844912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a17f4-3603-4614-a7b2-835ec1ad5d4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:28.848342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a17f4-3603-4614-a7b2-835ec1ad5d4b service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:28.887128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 828/1657] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:28.898671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:29.128687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:29.529337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec9c0-c0f1-4d68-b025-ecfa1339db6c service placement] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:29.531457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-778ec9c0-c0f1-4d68-b025-ecfa1339db6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:29.571155 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec9c0-c0f1-4d68-b025-ecfa1339db6c service placement] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:29.578882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:29.579549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:29.579832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:29.581455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] PATH_INFO: `/v3/users/8af3239fb2aa411d826c92faa2f5e171` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:29.584799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af3239fb2aa411d826c92faa2f5e171)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:29.585917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: WARNING py.warnings [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:28:29.585917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: warnings.warn(msg) Aug 31 19:28:29.585917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: Aug 31 19:28:29.587179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:29.911242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a17f4-3603-4614-a7b2-835ec1ad5d4b service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:29.912730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f18a17f4-3603-4614-a7b2-835ec1ad5d4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:29.933840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a17f4-3603-4614-a7b2-835ec1ad5d4b service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:29.951372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:29.952242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:29.952703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:29.953136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] PATH_INFO: `/v3/projects/f1e9c18961614bf0aa3099dc9e4a635b` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:29.954646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e9c18961614bf0aa3099dc9e4a635b)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:29.956547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: WARNING py.warnings [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:28:29.956547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: warnings.warn(msg) Aug 31 19:28:29.956547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: Aug 31 19:28:29.958700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:30.091951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af3239fb2aa411d826c92faa2f5e171'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:30.095075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af3239fb2aa411d826c92faa2f5e171'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:30.098011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af3239fb2aa411d826c92faa2f5e171'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:30.302035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af3239fb2aa411d826c92faa2f5e171'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:30.402106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8a342883-3679-42c6-8023-b2c8f0add1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af3239fb2aa411d826c92faa2f5e171'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:30.420171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e9c18961614bf0aa3099dc9e4a635b', 'request_id': 'req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:30.472670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 830/1658] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:28:29 2022] DELETE /identity/v3/users/8af3239fb2aa411d826c92faa2f5e171 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:30.478843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e9c18961614bf0aa3099dc9e4a635b', 'request_id': 'req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:30.613238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e9c18961614bf0aa3099dc9e4a635b', 'request_id': 'req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:30.636114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] The token cache is being invalidate because project f1e9c18961614bf0aa3099dc9e4a635b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:28:30.636417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:30.638596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:30.641395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 829/1659] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:28:29 2022] DELETE /identity/v3/projects/f1e9c18961614bf0aa3099dc9e4a635b => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:28:30.650644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ee58-30f2-4a44-8245-43b762a63357 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:30.650952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ee58-30f2-4a44-8245-43b762a63357 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:30.651240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ee58-30f2-4a44-8245-43b762a63357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:30.703929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-fea9ee58-30f2-4a44-8245-43b762a63357 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:30.706016 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fea9ee58-30f2-4a44-8245-43b762a63357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:30.804443 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:30.854494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:30.856834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:30.880909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 831/1660] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:30.887148 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156955a-5b99-4e1c-bb58-0d6d30596ea7 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:30.887640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156955a-5b99-4e1c-bb58-0d6d30596ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:30.888205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156955a-5b99-4e1c-bb58-0d6d30596ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:30.925304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1156955a-5b99-4e1c-bb58-0d6d30596ea7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:30.927099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1156955a-5b99-4e1c-bb58-0d6d30596ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:30.950029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 832/1661] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:30.954764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156955a-5b99-4e1c-bb58-0d6d30596ea7 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:30.972808 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156955a-5b99-4e1c-bb58-0d6d30596ea7 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:30.984003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d13d2-c0bc-46fb-a411-105c068d3e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:30.984640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d13d2-c0bc-46fb-a411-105c068d3e76 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:30.988763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d13d2-c0bc-46fb-a411-105c068d3e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:30.988763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d13d2-c0bc-46fb-a411-105c068d3e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:30.988763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d13d2-c0bc-46fb-a411-105c068d3e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:30.988763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d13d2-c0bc-46fb-a411-105c068d3e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:30.994159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d13d2-c0bc-46fb-a411-105c068d3e76 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:30.996616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf265e-f994-415e-9d0c-7ff04c6dfddd admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:31.009160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:31.009992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:31.010462 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:31.010882 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] PATH_INFO: `/v3/users/74a0a587ca4b460494757ad7951a5467` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:31.012739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a0a587ca4b460494757ad7951a5467)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:31.014876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:31.021379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 833/1662] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:31.029015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d13d2-c0bc-46fb-a411-105c068d3e76 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:31.047798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d13d2-c0bc-46fb-a411-105c068d3e76 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:31.062564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98f46d-f666-4c21-a55b-633031cbdbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:31.063914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f46d-f666-4c21-a55b-633031cbdbab admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:31.064309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f46d-f666-4c21-a55b-633031cbdbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:31.064654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98f46d-f666-4c21-a55b-633031cbdbab admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:31.065466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98f46d-f666-4c21-a55b-633031cbdbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:31.070460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98f46d-f666-4c21-a55b-633031cbdbab admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:31.204616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 834/1663] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:31 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:31.212681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98f46d-f666-4c21-a55b-633031cbdbab admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:31.297508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98f46d-f666-4c21-a55b-633031cbdbab admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:31.305109 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e011b-c443-4fc7-b00e-cf981900f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:31.305998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e011b-c443-4fc7-b00e-cf981900f3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:31.307109 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e011b-c443-4fc7-b00e-cf981900f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:31.307771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e011b-c443-4fc7-b00e-cf981900f3a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:31.308878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e011b-c443-4fc7-b00e-cf981900f3a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:31.311275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e011b-c443-4fc7-b00e-cf981900f3a5 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:31.427398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a0a587ca4b460494757ad7951a5467'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:31.494907 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 835/1664] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:31 2022] POST /identity/v3/users => generated 284 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:31.497425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e011b-c443-4fc7-b00e-cf981900f3a5 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:31.509513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e011b-c443-4fc7-b00e-cf981900f3a5 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:31.515277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967d6eb-3d83-4e7b-b2ad-f84f079d37f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:31.516717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967d6eb-3d83-4e7b-b2ad-f84f079d37f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:31.517469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967d6eb-3d83-4e7b-b2ad-f84f079d37f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:31.522992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967d6eb-3d83-4e7b-b2ad-f84f079d37f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:31.522992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967d6eb-3d83-4e7b-b2ad-f84f079d37f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:31.522992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967d6eb-3d83-4e7b-b2ad-f84f079d37f7 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:31.537494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 836/1665] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:31.538952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967d6eb-3d83-4e7b-b2ad-f84f079d37f7 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:31.550505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967d6eb-3d83-4e7b-b2ad-f84f079d37f7 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:31.556075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157856-903d-4963-83f2-a915cb74504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:31.556890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157856-903d-4963-83f2-a915cb74504d admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:31.557489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157856-903d-4963-83f2-a915cb74504d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:31.557926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157856-903d-4963-83f2-a915cb74504d admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:31.558588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157856-903d-4963-83f2-a915cb74504d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:31.565474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a0a587ca4b460494757ad7951a5467'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:31.566709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a0a587ca4b460494757ad7951a5467'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:31.589378 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157856-903d-4963-83f2-a915cb74504d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:31.616054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a0a587ca4b460494757ad7951a5467'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:31.616922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3268997f-57eb-4736-90a2-3c0f2b080347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a0a587ca4b460494757ad7951a5467'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:31.630657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 837/1666] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:31.632624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157856-903d-4963-83f2-a915cb74504d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:31.639564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-68157856-903d-4963-83f2-a915cb74504d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:31.671348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 830/1667] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:28:30 2022] DELETE /identity/v3/users/74a0a587ca4b460494757ad7951a5467 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:28:31.674468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980537-14bf-4f1c-a52c-8d78b2cc6828 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:31.674542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980537-14bf-4f1c-a52c-8d78b2cc6828 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:31.674817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980537-14bf-4f1c-a52c-8d78b2cc6828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:31.699293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157856-903d-4963-83f2-a915cb74504d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:31.762006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c9980537-14bf-4f1c-a52c-8d78b2cc6828 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:31.769462 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c9980537-14bf-4f1c-a52c-8d78b2cc6828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:31.817129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:31.930427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c30302-847f-4448-aac2-a4271651db4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:31.931119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c30302-847f-4448-aac2-a4271651db4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:31.931583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c30302-847f-4448-aac2-a4271651db4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:31.932367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c30302-847f-4448-aac2-a4271651db4e admin admin] PATH_INFO: `/v3/projects/04f146460ba54762961f942013a9d3c8/users/4d312e03480b425cbe50df05e2315329/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:31.967516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c30302-847f-4448-aac2-a4271651db4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f146460ba54762961f942013a9d3c8, user_id=4d312e03480b425cbe50df05e2315329, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:31.970486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c30302-847f-4448-aac2-a4271651db4e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:31.989765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 831/1668] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:31.990975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9980537-14bf-4f1c-a52c-8d78b2cc6828 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:31.998153 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c9980537-14bf-4f1c-a52c-8d78b2cc6828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:32.029849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9980537-14bf-4f1c-a52c-8d78b2cc6828 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:32.042814 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:32.043720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:32.045569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:32.046037 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] PATH_INFO: `/v3/projects/e2d41152f0374a4694120833721ef7ef` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:32.049660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d41152f0374a4694120833721ef7ef)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:32.052603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:32.092683 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 838/1669] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:31 2022] PUT /identity/v3/projects/04f146460ba54762961f942013a9d3c8/users/4d312e03480b425cbe50df05e2315329/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:32.094012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c30302-847f-4448-aac2-a4271651db4e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:32.096329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a4c30302-847f-4448-aac2-a4271651db4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:32.233265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c30302-847f-4448-aac2-a4271651db4e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:32.248883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d41152f0374a4694120833721ef7ef', 'request_id': 'req-9e1eb79d-8208-4792-a7cc-99d09e463376'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:32.264270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d41152f0374a4694120833721ef7ef', 'request_id': 'req-9e1eb79d-8208-4792-a7cc-99d09e463376'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:32.327606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69777a57-5d73-45aa-878b-aad43571fa83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:32.328412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69777a57-5d73-45aa-878b-aad43571fa83 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:32.328807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69777a57-5d73-45aa-878b-aad43571fa83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:32.329175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69777a57-5d73-45aa-878b-aad43571fa83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:32.339926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d41152f0374a4694120833721ef7ef', 'request_id': 'req-9e1eb79d-8208-4792-a7cc-99d09e463376'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:32.358233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] The token cache is being invalidate because project e2d41152f0374a4694120833721ef7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:28:32.359182 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:32.360269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9e1eb79d-8208-4792-a7cc-99d09e463376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:32.362077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 832/1670] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:28:31 2022] DELETE /identity/v3/projects/e2d41152f0374a4694120833721ef7ef => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:32.366114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acba24-f092-43cb-9d84-3016d50d4d40 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:32.370437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acba24-f092-43cb-9d84-3016d50d4d40 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:32.370933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acba24-f092-43cb-9d84-3016d50d4d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:32.433401 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-49acba24-f092-43cb-9d84-3016d50d4d40 None None] MFA Rules not processed for user `4d312e03480b425cbe50df05e2315329`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:32.437779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-49acba24-f092-43cb-9d84-3016d50d4d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:32.484847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69777a57-5d73-45aa-878b-aad43571fa83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:32.488342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69777a57-5d73-45aa-878b-aad43571fa83 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:32.511217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 839/1671] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:32.512130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69777a57-5d73-45aa-878b-aad43571fa83 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:32.561051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69777a57-5d73-45aa-878b-aad43571fa83 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:32.580663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:32.581787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:32.587280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:32.587710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] PATH_INFO: `/v3/users/98141f2708ae4eb6b7fa8db58f7bbf18` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:32.593120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=98141f2708ae4eb6b7fa8db58f7bbf18)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:32.602672 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:32.609077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 833/1672] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:32.622577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acba24-f092-43cb-9d84-3016d50d4d40 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:32.624020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-49acba24-f092-43cb-9d84-3016d50d4d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:32.767487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acba24-f092-43cb-9d84-3016d50d4d40 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:32.779024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61272d8f-bf5a-409f-a68a-fb6b9333d907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:32.779667 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272d8f-bf5a-409f-a68a-fb6b9333d907 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:32.779950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272d8f-bf5a-409f-a68a-fb6b9333d907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:32.780229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272d8f-bf5a-409f-a68a-fb6b9333d907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:32.800261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61272d8f-bf5a-409f-a68a-fb6b9333d907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:32.802520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61272d8f-bf5a-409f-a68a-fb6b9333d907 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:32.819908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 834/1673] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:28:32.959958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4e04-f894-41ed-bdf4-1721bcbfabde None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:32.960417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4e04-f894-41ed-bdf4-1721bcbfabde None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:32.960752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4e04-f894-41ed-bdf4-1721bcbfabde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:33.027540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98141f2708ae4eb6b7fa8db58f7bbf18'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:33.041045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98141f2708ae4eb6b7fa8db58f7bbf18'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:33.041045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98141f2708ae4eb6b7fa8db58f7bbf18'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:33.121963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-09ab4e04-f894-41ed-bdf4-1721bcbfabde None None] MFA Rules not processed for user `6773bc20a0d740e588f1858e5e9b1d11`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:33.123316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-09ab4e04-f894-41ed-bdf4-1721bcbfabde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:33.245514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98141f2708ae4eb6b7fa8db58f7bbf18'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:33.282071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98141f2708ae4eb6b7fa8db58f7bbf18'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:33.336080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 835/1674] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:33.347011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b0964-c7fe-4723-bc87-d6769b800b5c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:33.347525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b0964-c7fe-4723-bc87-d6769b800b5c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:33.347947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b0964-c7fe-4723-bc87-d6769b800b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:33.350748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 840/1675] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:28:32 2022] DELETE /identity/v3/users/98141f2708ae4eb6b7fa8db58f7bbf18 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:33.388476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ac8b0964-c7fe-4723-bc87-d6769b800b5c None None] MFA Rules not processed for user `6773bc20a0d740e588f1858e5e9b1d11`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:33.390073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ac8b0964-c7fe-4723-bc87-d6769b800b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:33.537355 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 836/1676] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:33.551355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:33.554100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:33.731715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480d0ba-99e4-4d4b-a292-af3242845cea admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:33.753536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abf809-f369-4116-9981-bd991f51c877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:33.753536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf809-f369-4116-9981-bd991f51c877 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:33.756990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf809-f369-4116-9981-bd991f51c877 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:33.757345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abf809-f369-4116-9981-bd991f51c877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:33.795039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abf809-f369-4116-9981-bd991f51c877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:33.796744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abf809-f369-4116-9981-bd991f51c877 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:33.822828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 841/1677] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:33.837228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:35.079322 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b0964-c7fe-4723-bc87-d6769b800b5c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:35.081126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ac8b0964-c7fe-4723-bc87-d6769b800b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:35.128268 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7c1fc-ee6c-4861-8b99-f6296024f532 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:35.130399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7c1fc-ee6c-4861-8b99-f6296024f532 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:35.130842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7c1fc-ee6c-4861-8b99-f6296024f532 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:35.132962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 842/1678] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 31 19:28:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:28:35.151829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50eba6-3580-45ca-ae09-84fc4039d07f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:35.152492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50eba6-3580-45ca-ae09-84fc4039d07f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:35.153397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50eba6-3580-45ca-ae09-84fc4039d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:35.263529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b0964-c7fe-4723-bc87-d6769b800b5c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:35.273271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:35.274242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:35.274691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:35.275132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] PATH_INFO: `/v3/projects/49a52a616fa346aab45a3c60ac2b665f` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:35.276303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-cc50eba6-3580-45ca-ae09-84fc4039d07f None None] MFA Rules not processed for user `b263d1092fc148129020ba73f2b8fbd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:35.276845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a52a616fa346aab45a3c60ac2b665f)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:35.277724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cc50eba6-3580-45ca-ae09-84fc4039d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:35.289313 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:35.428776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 843/1679] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:35.458461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50eba6-3580-45ca-ae09-84fc4039d07f None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:35.462699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cc50eba6-3580-45ca-ae09-84fc4039d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:35.490052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50eba6-3580-45ca-ae09-84fc4039d07f None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:35.499382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a52a616fa346aab45a3c60ac2b665f', 'request_id': 'req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:35.522900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a52a616fa346aab45a3c60ac2b665f', 'request_id': 'req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:35.626672 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223a3b0-14cc-4001-9dce-a8b1e04c3bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:35.627391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223a3b0-14cc-4001-9dce-a8b1e04c3bef service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:35.628481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223a3b0-14cc-4001-9dce-a8b1e04c3bef service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:35.628938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223a3b0-14cc-4001-9dce-a8b1e04c3bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:35.639392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223a3b0-14cc-4001-9dce-a8b1e04c3bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:35.641200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223a3b0-14cc-4001-9dce-a8b1e04c3bef service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:35.661597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 844/1680] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:35.663080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d95eb-8f6d-4f96-91da-ceb42045498a None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:35.663368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d95eb-8f6d-4f96-91da-ceb42045498a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:35.663648 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d95eb-8f6d-4f96-91da-ceb42045498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:35.720286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a52a616fa346aab45a3c60ac2b665f', 'request_id': 'req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:35.738883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] The token cache is being invalidate because project 49a52a616fa346aab45a3c60ac2b665f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:28:35.738883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:35.743294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-93bb09b8-3b8c-434b-8f89-239f4fbb11c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:35.749586 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 837/1681] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:28:35 2022] DELETE /identity/v3/projects/49a52a616fa346aab45a3c60ac2b665f => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:28:35.754548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736872f9-cbde-4af7-b375-1ce98d501754 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:35.754870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736872f9-cbde-4af7-b375-1ce98d501754 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:35.755343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736872f9-cbde-4af7-b375-1ce98d501754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:35.760510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-920d95eb-8f6d-4f96-91da-ceb42045498a None None] MFA Rules not processed for user `fb4ecdfb04cb435a9569e84080a236e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:35.761812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-920d95eb-8f6d-4f96-91da-ceb42045498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:35.798547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-736872f9-cbde-4af7-b375-1ce98d501754 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:35.799815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-736872f9-cbde-4af7-b375-1ce98d501754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:35.908678 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 845/1682] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:35.914138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d95eb-8f6d-4f96-91da-ceb42045498a None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:35.916844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-920d95eb-8f6d-4f96-91da-ceb42045498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:35.971115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 838/1683] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:35.971115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ddf0d-9d78-46f9-b95b-9b54fd5a3f89 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:35.971115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ddf0d-9d78-46f9-b95b-9b54fd5a3f89 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:35.971115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ddf0d-9d78-46f9-b95b-9b54fd5a3f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:36.001280 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-505ddf0d-9d78-46f9-b95b-9b54fd5a3f89 None None] MFA Rules not processed for user `fb4ecdfb04cb435a9569e84080a236e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:36.004426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-505ddf0d-9d78-46f9-b95b-9b54fd5a3f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:36.042728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 839/1684] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:36.045311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad7f2e-ed3a-4fc9-b9f6-880b549b7b00 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:36.045825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad7f2e-ed3a-4fc9-b9f6-880b549b7b00 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:36.046237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad7f2e-ed3a-4fc9-b9f6-880b549b7b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:36.058896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d95eb-8f6d-4f96-91da-ceb42045498a None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:36.065916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:36.066568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:36.066966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:36.067497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] PATH_INFO: `/v3/projects/bd082a082dc940c78a9b6eed1fa24726` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:36.069218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd082a082dc940c78a9b6eed1fa24726)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:36.071637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:36.078297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-2aad7f2e-ed3a-4fc9-b9f6-880b549b7b00 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:36.079762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2aad7f2e-ed3a-4fc9-b9f6-880b549b7b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:36.100069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 840/1685] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:36.101149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad7f2e-ed3a-4fc9-b9f6-880b549b7b00 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:36.103002 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2aad7f2e-ed3a-4fc9-b9f6-880b549b7b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:36.243989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd082a082dc940c78a9b6eed1fa24726', 'request_id': 'req-f26da62e-2cf1-455e-a677-ba3586d9dacb'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:36.253300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad7f2e-ed3a-4fc9-b9f6-880b549b7b00 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:36.255654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd082a082dc940c78a9b6eed1fa24726', 'request_id': 'req-f26da62e-2cf1-455e-a677-ba3586d9dacb'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:36.366164 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd3df7-ad71-457a-8a2c-652ffe80479c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:36.367060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3df7-ad71-457a-8a2c-652ffe80479c service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:36.367502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3df7-ad71-457a-8a2c-652ffe80479c service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:36.368489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3df7-ad71-457a-8a2c-652ffe80479c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:36.379921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd082a082dc940c78a9b6eed1fa24726', 'request_id': 'req-f26da62e-2cf1-455e-a677-ba3586d9dacb'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:36.396460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] The token cache is being invalidate because project bd082a082dc940c78a9b6eed1fa24726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:28:36.397181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:36.399344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:36.403669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 846/1686] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:28:35 2022] DELETE /identity/v3/projects/bd082a082dc940c78a9b6eed1fa24726 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:36.406212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:36.409565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:36.525909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:36.600704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd3df7-ad71-457a-8a2c-652ffe80479c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:36.610857 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd3df7-ad71-457a-8a2c-652ffe80479c service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:36.647592 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 841/1687] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:36.651877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d9018-e5ba-417d-a1fe-5ed4b5b94f63 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:36.652179 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d9018-e5ba-417d-a1fe-5ed4b5b94f63 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:36.652462 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d9018-e5ba-417d-a1fe-5ed4b5b94f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:36.690248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da62e-2cf1-455e-a677-ba3586d9dacb admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:36.712286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06abaab-00de-4403-bbbf-c22ca51d209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:36.712934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06abaab-00de-4403-bbbf-c22ca51d209c admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:36.713230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06abaab-00de-4403-bbbf-c22ca51d209c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:36.713485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06abaab-00de-4403-bbbf-c22ca51d209c admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:36.714190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06abaab-00de-4403-bbbf-c22ca51d209c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:36.714494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06abaab-00de-4403-bbbf-c22ca51d209c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:36.717306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06abaab-00de-4403-bbbf-c22ca51d209c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:36.761936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 847/1688] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:36.761936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06abaab-00de-4403-bbbf-c22ca51d209c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:36.769027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f06abaab-00de-4403-bbbf-c22ca51d209c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:36.786742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-dc6d9018-e5ba-417d-a1fe-5ed4b5b94f63 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:36.798217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-dc6d9018-e5ba-417d-a1fe-5ed4b5b94f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:36.887093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 842/1689] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:36.895488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db12a-1a97-4575-8e5c-d4d5dc09957f None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:36.895775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db12a-1a97-4575-8e5c-d4d5dc09957f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:36.896057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db12a-1a97-4575-8e5c-d4d5dc09957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:36.958720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-534db12a-1a97-4575-8e5c-d4d5dc09957f None None] MFA Rules not processed for user `6773bc20a0d740e588f1858e5e9b1d11`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:36.959951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-534db12a-1a97-4575-8e5c-d4d5dc09957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:37.043518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06abaab-00de-4403-bbbf-c22ca51d209c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:37.066243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424483e-688d-42df-b9be-2ef28aefc1d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:37.067104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424483e-688d-42df-b9be-2ef28aefc1d4 service placement] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:37.067479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424483e-688d-42df-b9be-2ef28aefc1d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:37.067847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424483e-688d-42df-b9be-2ef28aefc1d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:37.079973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9424483e-688d-42df-b9be-2ef28aefc1d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:37.121746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424483e-688d-42df-b9be-2ef28aefc1d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:37.121746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424483e-688d-42df-b9be-2ef28aefc1d4 service placement] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:37.139575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 848/1690] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:37.141585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424483e-688d-42df-b9be-2ef28aefc1d4 service placement] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:37.200533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424483e-688d-42df-b9be-2ef28aefc1d4 service placement] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:37.219770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7694c-4417-40e8-a8d7-ed353919578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:37.220511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7694c-4417-40e8-a8d7-ed353919578a admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:37.220862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7694c-4417-40e8-a8d7-ed353919578a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:37.221213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7694c-4417-40e8-a8d7-ed353919578a admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:37.221959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7694c-4417-40e8-a8d7-ed353919578a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:37.224911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7694c-4417-40e8-a8d7-ed353919578a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:37.227999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 843/1691] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:37.247332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bc33f-fba0-4982-9872-a8a068fb6f5c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:37.252549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bc33f-fba0-4982-9872-a8a068fb6f5c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:37.253002 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bc33f-fba0-4982-9872-a8a068fb6f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:37.324197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-627bc33f-fba0-4982-9872-a8a068fb6f5c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:37.335207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-627bc33f-fba0-4982-9872-a8a068fb6f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:37.360213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 844/1692] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:37.374850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bc33f-fba0-4982-9872-a8a068fb6f5c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:37.384041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 849/1693] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:37 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:37.385507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7694c-4417-40e8-a8d7-ed353919578a admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:37.416476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bc33f-fba0-4982-9872-a8a068fb6f5c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:37.630276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7694c-4417-40e8-a8d7-ed353919578a admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:37.638888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2960d8-2b27-4cc3-a8ca-ea79b1cca8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:37.639591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2960d8-2b27-4cc3-a8ca-ea79b1cca8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:37.639896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2960d8-2b27-4cc3-a8ca-ea79b1cca8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:37.640340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2960d8-2b27-4cc3-a8ca-ea79b1cca8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:37.641475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2960d8-2b27-4cc3-a8ca-ea79b1cca8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:37.641829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2960d8-2b27-4cc3-a8ca-ea79b1cca8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:37.645932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bbe23-046a-491e-8b91-031c9fa4376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:37.648886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bbe23-046a-491e-8b91-031c9fa4376b admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:37.650036 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bbe23-046a-491e-8b91-031c9fa4376b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:37.651093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bbe23-046a-491e-8b91-031c9fa4376b admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:37.653730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bbe23-046a-491e-8b91-031c9fa4376b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:37.654015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2960d8-2b27-4cc3-a8ca-ea79b1cca8a3 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:37.657319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bbe23-046a-491e-8b91-031c9fa4376b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:37.683829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 845/1694] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:37.689513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2960d8-2b27-4cc3-a8ca-ea79b1cca8a3 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:37.734795 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2960d8-2b27-4cc3-a8ca-ea79b1cca8a3 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:37.752748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c4f74-b0f9-4ab3-9675-dedc34a80cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:37.754838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c4f74-b0f9-4ab3-9675-dedc34a80cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:37.761101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c4f74-b0f9-4ab3-9675-dedc34a80cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:37.761101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c4f74-b0f9-4ab3-9675-dedc34a80cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:37.761101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c4f74-b0f9-4ab3-9675-dedc34a80cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:37.773223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c4f74-b0f9-4ab3-9675-dedc34a80cb5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:37.845352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 850/1695] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:37 2022] POST /identity/v3/users => generated 288 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:37.845352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b19ce-ef12-4cf0-97ff-86e3927764b5 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:37.845352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b19ce-ef12-4cf0-97ff-86e3927764b5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:37.845352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b19ce-ef12-4cf0-97ff-86e3927764b5 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:37.847627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 851/1696] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 31 19:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:28:37.851156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b19ce-ef12-4cf0-97ff-86e3927764b5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:37.901590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b19ce-ef12-4cf0-97ff-86e3927764b5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:37.928207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45ba56-c9b6-485e-8c79-fbdb44eae591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:37.929100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45ba56-c9b6-485e-8c79-fbdb44eae591 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:37.929520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45ba56-c9b6-485e-8c79-fbdb44eae591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:37.929968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45ba56-c9b6-485e-8c79-fbdb44eae591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:37.930781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45ba56-c9b6-485e-8c79-fbdb44eae591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:37.933442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45ba56-c9b6-485e-8c79-fbdb44eae591 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:37.940597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 846/1697] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:37 2022] POST /identity/v3/projects => generated 365 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:28:37.948331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c78c0-319c-4c23-b910-2f1620997192 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:37.948801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c78c0-319c-4c23-b910-2f1620997192 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:37.949178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c78c0-319c-4c23-b910-2f1620997192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:37.965548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 852/1698] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:37.965548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c997a-b816-4840-9255-1ff67bee3a30 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:37.965548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c997a-b816-4840-9255-1ff67bee3a30 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:37.965548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c997a-b816-4840-9255-1ff67bee3a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:37.980142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-208c78c0-319c-4c23-b910-2f1620997192 None None] MFA Rules not processed for user `b263d1092fc148129020ba73f2b8fbd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:37.981733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-208c78c0-319c-4c23-b910-2f1620997192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:38.028602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-8b0c997a-b816-4840-9255-1ff67bee3a30 None None] MFA Rules not processed for user `9b0a09141e3748359837fed83f0eff98`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:38.028602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8b0c997a-b816-4840-9255-1ff67bee3a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:38.150726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 847/1699] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:38.154990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c78c0-319c-4c23-b910-2f1620997192 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:38.302829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 853/1700] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:38.303690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c997a-b816-4840-9255-1ff67bee3a30 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:38.416804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c78c0-319c-4c23-b910-2f1620997192 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:38.450677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:38.457273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d00a2-690b-4ae7-9b7a-ea5c36d4f3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:38.458226 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d00a2-690b-4ae7-9b7a-ea5c36d4f3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:38.458584 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d00a2-690b-4ae7-9b7a-ea5c36d4f3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:38.458928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d00a2-690b-4ae7-9b7a-ea5c36d4f3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:38.460256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d00a2-690b-4ae7-9b7a-ea5c36d4f3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:38.463210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d00a2-690b-4ae7-9b7a-ea5c36d4f3f7 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:38.514458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c997a-b816-4840-9255-1ff67bee3a30 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:38.524857 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4a567-bfd6-4d42-b115-9d47e488a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:38.527386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4a567-bfd6-4d42-b115-9d47e488a12c admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:38.527752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4a567-bfd6-4d42-b115-9d47e488a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:38.528107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4a567-bfd6-4d42-b115-9d47e488a12c admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:38.528863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4a567-bfd6-4d42-b115-9d47e488a12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:38.532424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4a567-bfd6-4d42-b115-9d47e488a12c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:38.558354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 854/1701] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:38.562488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae51ed1-5a98-4761-bd65-40ec048b7a0e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:38.562991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae51ed1-5a98-4761-bd65-40ec048b7a0e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:38.563419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae51ed1-5a98-4761-bd65-40ec048b7a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:38.610749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4ae51ed1-5a98-4761-bd65-40ec048b7a0e None None] MFA Rules not processed for user `27d710f7757e427fbf3921ab488b0ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:38.612942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4ae51ed1-5a98-4761-bd65-40ec048b7a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:38.637428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 848/1702] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:38 2022] POST /identity/v3/users => generated 283 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:38.638636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d00a2-690b-4ae7-9b7a-ea5c36d4f3f7 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:38.643170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d20d00a2-690b-4ae7-9b7a-ea5c36d4f3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:38.686226 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d00a2-690b-4ae7-9b7a-ea5c36d4f3f7 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:38.702653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61c2d-4c16-4954-ac26-8471599a9c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:38.703254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61c2d-4c16-4954-ac26-8471599a9c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:38.703544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61c2d-4c16-4954-ac26-8471599a9c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:38.704012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61c2d-4c16-4954-ac26-8471599a9c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:38.726561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce61c2d-4c16-4954-ac26-8471599a9c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:38.728068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce61c2d-4c16-4954-ac26-8471599a9c4a service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:38.746453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 855/1703] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:38.748374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 849/1704] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:38.749819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61c2d-4c16-4954-ac26-8471599a9c4a service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:38.755942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae51ed1-5a98-4761-bd65-40ec048b7a0e None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:38.774781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61c2d-4c16-4954-ac26-8471599a9c4a service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:38.787610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f468e-d1a6-437e-9020-73d55f56cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:38.788240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f468e-d1a6-437e-9020-73d55f56cfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:38.788555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f468e-d1a6-437e-9020-73d55f56cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:38.788892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f468e-d1a6-437e-9020-73d55f56cfe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:38.789555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f468e-d1a6-437e-9020-73d55f56cfe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:38.790254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae51ed1-5a98-4761-bd65-40ec048b7a0e None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:38.793572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f468e-d1a6-437e-9020-73d55f56cfe9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:38.800807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e58f8-865f-44f6-965c-489366831990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:38.802891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e58f8-865f-44f6-965c-489366831990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:38.805061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e58f8-865f-44f6-965c-489366831990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:38.805745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e58f8-865f-44f6-965c-489366831990 admin admin] PATH_INFO: `/v3/projects/440c7645486749af8c9cb29fbdc125be/users/8613d0f5e9b044629d0efcd81ebb6952/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:38.820846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 850/1705] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:38.826060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f468e-d1a6-437e-9020-73d55f56cfe9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:38.847251 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e58f8-865f-44f6-965c-489366831990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440c7645486749af8c9cb29fbdc125be, user_id=8613d0f5e9b044629d0efcd81ebb6952, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:38.850893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e58f8-865f-44f6-965c-489366831990 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:38.852373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f468e-d1a6-437e-9020-73d55f56cfe9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:38.858633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d77747-cba2-4783-9783-d0546803a34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:38.859025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d77747-cba2-4783-9783-d0546803a34c admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:38.859475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d77747-cba2-4783-9783-d0546803a34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:38.859917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d77747-cba2-4783-9783-d0546803a34c admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:38.860766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d77747-cba2-4783-9783-d0546803a34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:38.862689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d77747-cba2-4783-9783-d0546803a34c admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:38.893177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 851/1706] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:28:38.898598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d77747-cba2-4783-9783-d0546803a34c admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:38.913649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d77747-cba2-4783-9783-d0546803a34c admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:38.931104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053cf59-870d-4776-9be7-744aeadf01c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:38.931817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053cf59-870d-4776-9be7-744aeadf01c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:38.932123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053cf59-870d-4776-9be7-744aeadf01c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:38.932393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053cf59-870d-4776-9be7-744aeadf01c2 admin admin] PATH_INFO: `/v3/projects/1eb2009c8df24519a6c9dcb8bd4e05b2/users/9f922e2528414a8383f14f28e6505c3d/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:38.964707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 856/1707] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:38 2022] PUT /identity/v3/projects/440c7645486749af8c9cb29fbdc125be/users/8613d0f5e9b044629d0efcd81ebb6952/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:38.977301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674b4f-40aa-40ab-b90a-096aeb0e431e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:38.977592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674b4f-40aa-40ab-b90a-096aeb0e431e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:38.978526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674b4f-40aa-40ab-b90a-096aeb0e431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:38.978646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053cf59-870d-4776-9be7-744aeadf01c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb2009c8df24519a6c9dcb8bd4e05b2, user_id=9f922e2528414a8383f14f28e6505c3d, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:38.981251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053cf59-870d-4776-9be7-744aeadf01c2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:39.040361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-be674b4f-40aa-40ab-b90a-096aeb0e431e None None] MFA Rules not processed for user `8613d0f5e9b044629d0efcd81ebb6952`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:39.041640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-be674b4f-40aa-40ab-b90a-096aeb0e431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:39.154654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 852/1708] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:38 2022] PUT /identity/v3/projects/1eb2009c8df24519a6c9dcb8bd4e05b2/users/9f922e2528414a8383f14f28e6505c3d/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:28:39.155750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053cf59-870d-4776-9be7-744aeadf01c2 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:39.162623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8053cf59-870d-4776-9be7-744aeadf01c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:39.194746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 857/1709] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:39.196392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827818ec-3910-437d-85a8-1534cf296a96 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:39.201600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827818ec-3910-437d-85a8-1534cf296a96 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:39.202158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827818ec-3910-437d-85a8-1534cf296a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:39.307450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-827818ec-3910-437d-85a8-1534cf296a96 None None] MFA Rules not processed for user `9f922e2528414a8383f14f28e6505c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:39.309034 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-827818ec-3910-437d-85a8-1534cf296a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:39.390683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053cf59-870d-4776-9be7-744aeadf01c2 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:39.402620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5d826-fb2b-4f53-a76e-36d43f3fcf00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:39.418692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5d826-fb2b-4f53-a76e-36d43f3fcf00 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:39.425222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5d826-fb2b-4f53-a76e-36d43f3fcf00 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:39.425222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5d826-fb2b-4f53-a76e-36d43f3fcf00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:39.556668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 858/1710] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:39.557634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827818ec-3910-437d-85a8-1534cf296a96 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:39.624288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5d826-fb2b-4f53-a76e-36d43f3fcf00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:39.626331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5d826-fb2b-4f53-a76e-36d43f3fcf00 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:39.644399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 853/1711] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:39.656623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827818ec-3910-437d-85a8-1534cf296a96 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:39.663176 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca9f28-7c93-4cc1-8a26-60bfc1856288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:39.663918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca9f28-7c93-4cc1-8a26-60bfc1856288 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:39.664298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca9f28-7c93-4cc1-8a26-60bfc1856288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:39.664670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca9f28-7c93-4cc1-8a26-60bfc1856288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:39.665433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca9f28-7c93-4cc1-8a26-60bfc1856288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:39.667858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca9f28-7c93-4cc1-8a26-60bfc1856288 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:39.847582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 859/1712] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:39 2022] POST /identity/v3/projects => generated 361 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:39.849486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5d826-fb2b-4f53-a76e-36d43f3fcf00 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:39.860680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5d826-fb2b-4f53-a76e-36d43f3fcf00 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:39.935632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca9f28-7c93-4cc1-8a26-60bfc1856288 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:39.969809 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bee1c2-d199-4d64-94a3-ee1a6658b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:39.970663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bee1c2-d199-4d64-94a3-ee1a6658b287 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:39.971051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bee1c2-d199-4d64-94a3-ee1a6658b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:39.971491 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bee1c2-d199-4d64-94a3-ee1a6658b287 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:39.972251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bee1c2-d199-4d64-94a3-ee1a6658b287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:39.974923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bee1c2-d199-4d64-94a3-ee1a6658b287 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:40.064095 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca9f28-7c93-4cc1-8a26-60bfc1856288 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:40.073161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01328-bb35-485b-9754-ae9604bc2ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:40.074030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01328-bb35-485b-9754-ae9604bc2ae8 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:40.074507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01328-bb35-485b-9754-ae9604bc2ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:40.075066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad01328-bb35-485b-9754-ae9604bc2ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:40.141626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 854/1713] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:39 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:40.144001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bee1c2-d199-4d64-94a3-ee1a6658b287 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:40.182291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bee1c2-d199-4d64-94a3-ee1a6658b287 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:40.196832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db460c56-e000-4323-88ad-5905f7901226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:40.197563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460c56-e000-4323-88ad-5905f7901226 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:40.197932 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460c56-e000-4323-88ad-5905f7901226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:40.198284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460c56-e000-4323-88ad-5905f7901226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:40.199034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db460c56-e000-4323-88ad-5905f7901226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:40.209334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad01328-bb35-485b-9754-ae9604bc2ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:40.211884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad01328-bb35-485b-9754-ae9604bc2ae8 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:40.216035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db460c56-e000-4323-88ad-5905f7901226 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:40.237988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 860/1714] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:28:40.249636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 855/1715] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:40.254038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01328-bb35-485b-9754-ae9604bc2ae8 service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:40.300368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad01328-bb35-485b-9754-ae9604bc2ae8 service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:40.466447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c6de-87f9-4556-80db-c81ae2412c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:40.466447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c6de-87f9-4556-80db-c81ae2412c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:40.466447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c6de-87f9-4556-80db-c81ae2412c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:40.466447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07c6de-87f9-4556-80db-c81ae2412c5c admin admin] PATH_INFO: `/v3/projects/651da7c80ab44a44a3313a4d8f0e4668/users/66e60c37738e4a3f915f9a9565771bfb/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:40.469099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07c6de-87f9-4556-80db-c81ae2412c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=651da7c80ab44a44a3313a4d8f0e4668, user_id=66e60c37738e4a3f915f9a9565771bfb, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:40.470237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db460c56-e000-4323-88ad-5905f7901226 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:40.470731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07c6de-87f9-4556-80db-c81ae2412c5c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:40.471059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-db460c56-e000-4323-88ad-5905f7901226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:40.474595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db460c56-e000-4323-88ad-5905f7901226 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:40.500625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abe2b1-aadb-42c0-8740-6ddf6a565784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:40.501477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abe2b1-aadb-42c0-8740-6ddf6a565784 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:40.501964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abe2b1-aadb-42c0-8740-6ddf6a565784 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:40.502547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abe2b1-aadb-42c0-8740-6ddf6a565784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:40.610435 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abe2b1-aadb-42c0-8740-6ddf6a565784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:40.610435 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abe2b1-aadb-42c0-8740-6ddf6a565784 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:40.643583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 856/1716] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:28:40.709809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 861/1717] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:40 2022] PUT /identity/v3/projects/651da7c80ab44a44a3313a4d8f0e4668/users/66e60c37738e4a3f915f9a9565771bfb/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:40.713714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abe2b1-aadb-42c0-8740-6ddf6a565784 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:40.747778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abe2b1-aadb-42c0-8740-6ddf6a565784 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:41.038272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6580c1-757a-432d-a814-1d9e7a4afed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:41.040415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6580c1-757a-432d-a814-1d9e7a4afed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:41.040887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6580c1-757a-432d-a814-1d9e7a4afed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:41.041403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6580c1-757a-432d-a814-1d9e7a4afed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:41.045817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6580c1-757a-432d-a814-1d9e7a4afed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:41.048192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6580c1-757a-432d-a814-1d9e7a4afed1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:41.103350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c6de-87f9-4556-80db-c81ae2412c5c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:41.104454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 857/1718] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:28:41.129611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07c6de-87f9-4556-80db-c81ae2412c5c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:41.155725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508367be-b54d-4e60-9282-43cf8aaca8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:41.156432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508367be-b54d-4e60-9282-43cf8aaca8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:41.156736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508367be-b54d-4e60-9282-43cf8aaca8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:41.157024 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508367be-b54d-4e60-9282-43cf8aaca8ff admin admin] PATH_INFO: `/v3/projects/651da7c80ab44a44a3313a4d8f0e4668/users/66e60c37738e4a3f915f9a9565771bfb/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:41.164730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508367be-b54d-4e60-9282-43cf8aaca8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=651da7c80ab44a44a3313a4d8f0e4668, user_id=66e60c37738e4a3f915f9a9565771bfb, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:41.179512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508367be-b54d-4e60-9282-43cf8aaca8ff admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:41.241367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 862/1719] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:41 2022] PUT /identity/v3/projects/651da7c80ab44a44a3313a4d8f0e4668/users/66e60c37738e4a3f915f9a9565771bfb/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:41.251883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70d6e9-37cf-46b8-aa61-e0e3517fd972 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:41.252214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70d6e9-37cf-46b8-aa61-e0e3517fd972 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:41.252553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70d6e9-37cf-46b8-aa61-e0e3517fd972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:41.288104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508367be-b54d-4e60-9282-43cf8aaca8ff admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:41.294088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-0f70d6e9-37cf-46b8-aa61-e0e3517fd972 None None] MFA Rules not processed for user `66e60c37738e4a3f915f9a9565771bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:41.295455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0f70d6e9-37cf-46b8-aa61-e0e3517fd972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:41.366499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508367be-b54d-4e60-9282-43cf8aaca8ff admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:41.371375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:41.372022 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:41.372307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:41.372583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] PATH_INFO: `/v3/users/8613d0f5e9b044629d0efcd81ebb6952` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:41.373956 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8613d0f5e9b044629d0efcd81ebb6952)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:41.376193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:41.390571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 858/1720] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:41.403847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70d6e9-37cf-46b8-aa61-e0e3517fd972 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:41.405469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0f70d6e9-37cf-46b8-aa61-e0e3517fd972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:41.580742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70d6e9-37cf-46b8-aa61-e0e3517fd972 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:41.583298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c65ebd-3db8-4c90-af84-3da2b2da8f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:41.584222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c65ebd-3db8-4c90-af84-3da2b2da8f43 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:41.584584 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c65ebd-3db8-4c90-af84-3da2b2da8f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:41.584931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c65ebd-3db8-4c90-af84-3da2b2da8f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:41.596849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c65ebd-3db8-4c90-af84-3da2b2da8f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:41.599845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c65ebd-3db8-4c90-af84-3da2b2da8f43 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:41.615574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 859/1721] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:42.071094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8613d0f5e9b044629d0efcd81ebb6952'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:42.077798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8613d0f5e9b044629d0efcd81ebb6952'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:42.077798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8613d0f5e9b044629d0efcd81ebb6952'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:42.190880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8613d0f5e9b044629d0efcd81ebb6952'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:42.214492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8613d0f5e9b044629d0efcd81ebb6952'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:42.233435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 863/1722] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:28:41 2022] DELETE /identity/v3/users/8613d0f5e9b044629d0efcd81ebb6952 => generated 0 bytes in 946 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:42.237788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7f411-98fe-4154-bb78-a5ae872116bd None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:42.238074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7f411-98fe-4154-bb78-a5ae872116bd None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:42.238369 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7f411-98fe-4154-bb78-a5ae872116bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:42.269147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-50f7f411-98fe-4154-bb78-a5ae872116bd None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:42.271160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-50f7f411-98fe-4154-bb78-a5ae872116bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:42.360431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:42.378092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 860/1723] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:42.390752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:42.392501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:42.424197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7f411-98fe-4154-bb78-a5ae872116bd None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:42.425802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-50f7f411-98fe-4154-bb78-a5ae872116bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:42.541065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7f411-98fe-4154-bb78-a5ae872116bd None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:42.560620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70035677-6bfe-4863-b49a-6709d0055d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:42.561514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70035677-6bfe-4863-b49a-6709d0055d47 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:42.561641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70035677-6bfe-4863-b49a-6709d0055d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:42.562082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70035677-6bfe-4863-b49a-6709d0055d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:42.564190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-70035677-6bfe-4863-b49a-6709d0055d47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:42.632965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d735ae-96c0-4339-8416-12567ae62430 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:42.646379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe101-f96e-48ee-90b5-de684e1fb895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:42.647026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe101-f96e-48ee-90b5-de684e1fb895 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:42.647307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe101-f96e-48ee-90b5-de684e1fb895 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:42.648369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe101-f96e-48ee-90b5-de684e1fb895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:42.696704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe101-f96e-48ee-90b5-de684e1fb895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:42.698637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe101-f96e-48ee-90b5-de684e1fb895 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:42.724873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70035677-6bfe-4863-b49a-6709d0055d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:42.725736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 864/1724] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:42.726698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70035677-6bfe-4863-b49a-6709d0055d47 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:42.746166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 861/1725] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:28:43.397196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:43.612702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe101-f96e-48ee-90b5-de684e1fb895 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:43.617506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-feabe101-f96e-48ee-90b5-de684e1fb895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:43.687327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe101-f96e-48ee-90b5-de684e1fb895 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:43.704854 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:43.705812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:43.706277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:43.706491 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] PATH_INFO: `/v3/projects/440c7645486749af8c9cb29fbdc125be` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:43.708027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440c7645486749af8c9cb29fbdc125be)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:43.711865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:44.067408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440c7645486749af8c9cb29fbdc125be', 'request_id': 'req-9b906572-6635-4450-8382-0f4e91101c76'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:44.079584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440c7645486749af8c9cb29fbdc125be', 'request_id': 'req-9b906572-6635-4450-8382-0f4e91101c76'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:44.232921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440c7645486749af8c9cb29fbdc125be', 'request_id': 'req-9b906572-6635-4450-8382-0f4e91101c76'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:44.271075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] The token cache is being invalidate because project 440c7645486749af8c9cb29fbdc125be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:28:44.272161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:44.273982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b906572-6635-4450-8382-0f4e91101c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:44.276644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 865/1726] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:28:43 2022] DELETE /identity/v3/projects/440c7645486749af8c9cb29fbdc125be => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:44.282667 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dbcbb-00c9-4486-956a-f13641bd9d19 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:44.283693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dbcbb-00c9-4486-956a-f13641bd9d19 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:44.284257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dbcbb-00c9-4486-956a-f13641bd9d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:44.312914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-880dbcbb-00c9-4486-956a-f13641bd9d19 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:44.315079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-880dbcbb-00c9-4486-956a-f13641bd9d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:44.474798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 862/1727] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:44.482238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228ce95-66fd-48b7-ab92-38a127b84de8 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:44.482818 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228ce95-66fd-48b7-ab92-38a127b84de8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:44.483356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228ce95-66fd-48b7-ab92-38a127b84de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:44.526840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-b228ce95-66fd-48b7-ab92-38a127b84de8 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:44.528098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b228ce95-66fd-48b7-ab92-38a127b84de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:44.541285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 866/1728] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:44.545606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dbcbb-00c9-4486-956a-f13641bd9d19 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:44.577738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dbcbb-00c9-4486-956a-f13641bd9d19 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:44.590590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bed8e-50dc-4f1b-826e-3e6f99ba41ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:44.593624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bed8e-50dc-4f1b-826e-3e6f99ba41ee admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:44.594070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bed8e-50dc-4f1b-826e-3e6f99ba41ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:44.618287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bed8e-50dc-4f1b-826e-3e6f99ba41ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:44.618287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bed8e-50dc-4f1b-826e-3e6f99ba41ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:44.618580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bed8e-50dc-4f1b-826e-3e6f99ba41ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:44.626211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bed8e-50dc-4f1b-826e-3e6f99ba41ee admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:44.681008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 863/1729] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:28:44.682211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228ce95-66fd-48b7-ab92-38a127b84de8 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:44.694752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228ce95-66fd-48b7-ab92-38a127b84de8 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:44.701997 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a444a-6449-402d-8f1c-e274ca0ea7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:44.703372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a444a-6449-402d-8f1c-e274ca0ea7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:44.704496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a444a-6449-402d-8f1c-e274ca0ea7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:44.704993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a444a-6449-402d-8f1c-e274ca0ea7a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:44.706163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a444a-6449-402d-8f1c-e274ca0ea7a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:44.708932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a444a-6449-402d-8f1c-e274ca0ea7a4 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:44.964278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 867/1730] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:44 2022] POST /identity/v3/projects => generated 381 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:44.967442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bed8e-50dc-4f1b-826e-3e6f99ba41ee admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:44.984104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bed8e-50dc-4f1b-826e-3e6f99ba41ee admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:45.139512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3091ac0-625a-43fb-a101-c1c6ba5bdb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:45.140157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3091ac0-625a-43fb-a101-c1c6ba5bdb91 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:45.140520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3091ac0-625a-43fb-a101-c1c6ba5bdb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:45.140828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3091ac0-625a-43fb-a101-c1c6ba5bdb91 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:45.141574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3091ac0-625a-43fb-a101-c1c6ba5bdb91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:45.145559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3091ac0-625a-43fb-a101-c1c6ba5bdb91 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:45.278398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 864/1731] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:44 2022] POST /identity/v3/users => generated 291 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:45.282929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a444a-6449-402d-8f1c-e274ca0ea7a4 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:45.312649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a444a-6449-402d-8f1c-e274ca0ea7a4 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:45.326753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935395a-df47-46de-b768-4679c7a3e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:45.327644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935395a-df47-46de-b768-4679c7a3e5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:45.328329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935395a-df47-46de-b768-4679c7a3e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:45.328976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935395a-df47-46de-b768-4679c7a3e5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:45.331273 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935395a-df47-46de-b768-4679c7a3e5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:45.333328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935395a-df47-46de-b768-4679c7a3e5e8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:45.365369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 868/1732] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:45.370433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3091ac0-625a-43fb-a101-c1c6ba5bdb91 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:45.383915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3091ac0-625a-43fb-a101-c1c6ba5bdb91 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:45.399053 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9e303-79c1-469f-b980-e18498477b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:45.400156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9e303-79c1-469f-b980-e18498477b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:45.400639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9e303-79c1-469f-b980-e18498477b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:45.401063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9e303-79c1-469f-b980-e18498477b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:45.407697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9e303-79c1-469f-b980-e18498477b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:45.408284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9e303-79c1-469f-b980-e18498477b12 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:45.433248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 865/1733] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:45.436649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935395a-df47-46de-b768-4679c7a3e5e8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:45.456611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935395a-df47-46de-b768-4679c7a3e5e8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:45.472446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3277a4c-f9f8-4162-97c1-994495581ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:45.474432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3277a4c-f9f8-4162-97c1-994495581ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:45.481795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3277a4c-f9f8-4162-97c1-994495581ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:45.481795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3277a4c-f9f8-4162-97c1-994495581ed4 admin admin] PATH_INFO: `/v3/projects/1a137a983c134b06893131ef67a9087a/users/245596bb3cb44646b3f06083e7e2a187/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:45.528295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3277a4c-f9f8-4162-97c1-994495581ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a137a983c134b06893131ef67a9087a, user_id=245596bb3cb44646b3f06083e7e2a187, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:45.533227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3277a4c-f9f8-4162-97c1-994495581ed4 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:45.557097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3a6db-a341-4c27-9235-36801c09a507 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:45.557639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3a6db-a341-4c27-9235-36801c09a507 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:45.558117 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3a6db-a341-4c27-9235-36801c09a507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:45.668056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 869/1734] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:45 2022] PUT /identity/v3/projects/1a137a983c134b06893131ef67a9087a/users/245596bb3cb44646b3f06083e7e2a187/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:45.669534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be8e27-a9c7-41da-b767-fb0490c77ae0 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:45.669871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be8e27-a9c7-41da-b767-fb0490c77ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:45.670157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be8e27-a9c7-41da-b767-fb0490c77ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:45.695964 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-89be8e27-a9c7-41da-b767-fb0490c77ae0 None None] MFA Rules not processed for user `9b0a09141e3748359837fed83f0eff98`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:45.698179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-89be8e27-a9c7-41da-b767-fb0490c77ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:45.709189 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e2b3a6db-a341-4c27-9235-36801c09a507 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:45.710738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e2b3a6db-a341-4c27-9235-36801c09a507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:45.769135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 870/1735] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:45.771453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddd383-0de1-4a76-b3db-cc3273501dd2 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:45.771893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddd383-0de1-4a76-b3db-cc3273501dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:45.773061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddd383-0de1-4a76-b3db-cc3273501dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:45.792174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 866/1736] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:45.815086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-91ddd383-0de1-4a76-b3db-cc3273501dd2 None None] MFA Rules not processed for user `245596bb3cb44646b3f06083e7e2a187`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:45.817032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-91ddd383-0de1-4a76-b3db-cc3273501dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:45.916394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3a6db-a341-4c27-9235-36801c09a507 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:45.918309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 871/1737] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:46.050483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3a6db-a341-4c27-9235-36801c09a507 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:46.059052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da815f-930d-41d3-b2fe-adf9d9822bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:46.059337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da815f-930d-41d3-b2fe-adf9d9822bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:46.059741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da815f-930d-41d3-b2fe-adf9d9822bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:46.060125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da815f-930d-41d3-b2fe-adf9d9822bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:46.060880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da815f-930d-41d3-b2fe-adf9d9822bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:46.063085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da815f-930d-41d3-b2fe-adf9d9822bfc admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:46.270846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 867/1738] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:45 2022] POST /identity/v3/projects => generated 379 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:46.272334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddd383-0de1-4a76-b3db-cc3273501dd2 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:46.289271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddd383-0de1-4a76-b3db-cc3273501dd2 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:46.423910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da815f-930d-41d3-b2fe-adf9d9822bfc admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:46.425659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b7da815f-930d-41d3-b2fe-adf9d9822bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:46.427531 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26bd33-5a32-47fa-8dd1-6b78e6b1c5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:46.428497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26bd33-5a32-47fa-8dd1-6b78e6b1c5ba admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:46.428964 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26bd33-5a32-47fa-8dd1-6b78e6b1c5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:46.429587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26bd33-5a32-47fa-8dd1-6b78e6b1c5ba admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:46.430440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26bd33-5a32-47fa-8dd1-6b78e6b1c5ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:46.432604 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26bd33-5a32-47fa-8dd1-6b78e6b1c5ba admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:46.655812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 872/1739] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:46 2022] POST /identity/v3/users => generated 296 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:46.656767 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26bd33-5a32-47fa-8dd1-6b78e6b1c5ba admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:46.677990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26bd33-5a32-47fa-8dd1-6b78e6b1c5ba admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:46.678909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da815f-930d-41d3-b2fe-adf9d9822bfc admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:46.690379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1be09-72c5-4be3-b828-f081ca60ceed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:46.693301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1be09-72c5-4be3-b828-f081ca60ceed service swift] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:46.693601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1be09-72c5-4be3-b828-f081ca60ceed service swift] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:46.693852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1be09-72c5-4be3-b828-f081ca60ceed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:46.700579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66aabeb-a1f4-424a-9d56-d5de0a1ee8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:46.701208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aabeb-a1f4-424a-9d56-d5de0a1ee8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:46.701688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aabeb-a1f4-424a-9d56-d5de0a1ee8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:46.701969 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aabeb-a1f4-424a-9d56-d5de0a1ee8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:46.702633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66aabeb-a1f4-424a-9d56-d5de0a1ee8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:46.704302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66aabeb-a1f4-424a-9d56-d5de0a1ee8e1 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:46.737814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 873/1740] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:46.744359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66aabeb-a1f4-424a-9d56-d5de0a1ee8e1 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:46.760462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66aabeb-a1f4-424a-9d56-d5de0a1ee8e1 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:46.788556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103da08-53d2-4d6f-9b91-13c58d1fc52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:46.789243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103da08-53d2-4d6f-9b91-13c58d1fc52d admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:46.789534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103da08-53d2-4d6f-9b91-13c58d1fc52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:46.789844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103da08-53d2-4d6f-9b91-13c58d1fc52d admin admin] PATH_INFO: `/v3/projects/63851e972dc64a56bd0e05dfb22a0627/users/a4f2e1bebb294ed2a38f7168eea8bf8e/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:46.807136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1be09-72c5-4be3-b828-f081ca60ceed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:46.809468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1be09-72c5-4be3-b828-f081ca60ceed service swift] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:46.843637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 868/1741] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:28:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 19:28:46.846521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103da08-53d2-4d6f-9b91-13c58d1fc52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63851e972dc64a56bd0e05dfb22a0627, user_id=a4f2e1bebb294ed2a38f7168eea8bf8e, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:46.850808 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103da08-53d2-4d6f-9b91-13c58d1fc52d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:46.900770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:46.986205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 874/1742] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:46 2022] PUT /identity/v3/projects/63851e972dc64a56bd0e05dfb22a0627/users/a4f2e1bebb294ed2a38f7168eea8bf8e/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:46.991310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1be09-72c5-4be3-b828-f081ca60ceed service swift] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:47.011432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1be09-72c5-4be3-b828-f081ca60ceed service swift] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:47.203637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee535e29-dd29-47c8-9d57-de9e5bfd7c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:47.204362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535e29-dd29-47c8-9d57-de9e5bfd7c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:47.204742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535e29-dd29-47c8-9d57-de9e5bfd7c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:47.205132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535e29-dd29-47c8-9d57-de9e5bfd7c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:47.206200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee535e29-dd29-47c8-9d57-de9e5bfd7c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:47.208500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee535e29-dd29-47c8-9d57-de9e5bfd7c97 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:47.273818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 869/1743] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:47.277824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103da08-53d2-4d6f-9b91-13c58d1fc52d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:47.298057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103da08-53d2-4d6f-9b91-13c58d1fc52d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:47.320555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b3799-ef60-4067-b319-028809e5647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:47.321730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3799-ef60-4067-b319-028809e5647c admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:47.325207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3799-ef60-4067-b319-028809e5647c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:47.325860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3799-ef60-4067-b319-028809e5647c admin admin] PATH_INFO: `/v3/projects/63851e972dc64a56bd0e05dfb22a0627/users/a4f2e1bebb294ed2a38f7168eea8bf8e/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:47.338059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b3799-ef60-4067-b319-028809e5647c admin admin] RBAC: Authorizing `identity:create_grant(project_id=63851e972dc64a56bd0e05dfb22a0627, user_id=a4f2e1bebb294ed2a38f7168eea8bf8e, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:47.345946 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b3799-ef60-4067-b319-028809e5647c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:47.389780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 875/1744] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:47 2022] PUT /identity/v3/projects/63851e972dc64a56bd0e05dfb22a0627/users/a4f2e1bebb294ed2a38f7168eea8bf8e/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:47.393725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd595c8-1e51-4ca2-ade7-7b78e135ac19 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:47.394061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd595c8-1e51-4ca2-ade7-7b78e135ac19 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:47.394452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd595c8-1e51-4ca2-ade7-7b78e135ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:47.483972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b0160-9c0d-492e-9477-3a4386acf65c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:47.484696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b0160-9c0d-492e-9477-3a4386acf65c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:47.485346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b0160-9c0d-492e-9477-3a4386acf65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:47.510633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-bbd595c8-1e51-4ca2-ade7-7b78e135ac19 None None] MFA Rules not processed for user `a4f2e1bebb294ed2a38f7168eea8bf8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:47.515788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bbd595c8-1e51-4ca2-ade7-7b78e135ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:47.542232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-561b0160-9c0d-492e-9477-3a4386acf65c None None] MFA Rules not processed for user `b263d1092fc148129020ba73f2b8fbd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:47.545361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-561b0160-9c0d-492e-9477-3a4386acf65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:47.779019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 876/1745] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Aug 31 19:28:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:47.799230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 870/1746] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:47.813057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b0160-9c0d-492e-9477-3a4386acf65c None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:47.816104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-561b0160-9c0d-492e-9477-3a4386acf65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:47.887581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd595c8-1e51-4ca2-ade7-7b78e135ac19 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:47.892557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bbd595c8-1e51-4ca2-ade7-7b78e135ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:48.015296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd595c8-1e51-4ca2-ade7-7b78e135ac19 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:48.015296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84cc1-6fa6-4b0e-a6d8-a853bb181112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:48.015296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84cc1-6fa6-4b0e-a6d8-a853bb181112 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:48.015296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84cc1-6fa6-4b0e-a6d8-a853bb181112 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:48.016311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84cc1-6fa6-4b0e-a6d8-a853bb181112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:48.016554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b0160-9c0d-492e-9477-3a4386acf65c None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:48.016554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896dfe6e-1990-4d2c-8c34-ae66497e6c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:48.016554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dfe6e-1990-4d2c-8c34-ae66497e6c74 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:48.016554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dfe6e-1990-4d2c-8c34-ae66497e6c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:48.017209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dfe6e-1990-4d2c-8c34-ae66497e6c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:48.017749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a84cc1-6fa6-4b0e-a6d8-a853bb181112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:48.017749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a84cc1-6fa6-4b0e-a6d8-a853bb181112 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:48.017749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 871/1747] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:48.018549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896dfe6e-1990-4d2c-8c34-ae66497e6c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:48.018549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896dfe6e-1990-4d2c-8c34-ae66497e6c74 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:48.018549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 877/1748] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:48.435524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84cc1-6fa6-4b0e-a6d8-a853bb181112 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:48.454330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84cc1-6fa6-4b0e-a6d8-a853bb181112 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:48.475701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e88e0-f415-4440-984c-1d835c7b98b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:48.476338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e88e0-f415-4440-984c-1d835c7b98b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:48.481786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e88e0-f415-4440-984c-1d835c7b98b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:48.482103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e88e0-f415-4440-984c-1d835c7b98b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:48.715652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e88e0-f415-4440-984c-1d835c7b98b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:48.718439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e88e0-f415-4440-984c-1d835c7b98b5 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:48.766023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 872/1749] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:49.557518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca38ecf-ad2e-4fde-a176-fc4ed388839d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:49.558572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca38ecf-ad2e-4fde-a176-fc4ed388839d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:49.559066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca38ecf-ad2e-4fde-a176-fc4ed388839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:49.580126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e88e0-f415-4440-984c-1d835c7b98b5 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:49.582264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-600e88e0-f415-4440-984c-1d835c7b98b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:49.638886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-7ca38ecf-ad2e-4fde-a176-fc4ed388839d None None] MFA Rules not processed for user `27d710f7757e427fbf3921ab488b0ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:49.640506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7ca38ecf-ad2e-4fde-a176-fc4ed388839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:49.700946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e88e0-f415-4440-984c-1d835c7b98b5 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:49.708365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:49.712256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:49.712256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:49.712256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] PATH_INFO: `/v3/users/9f922e2528414a8383f14f28e6505c3d` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:49.712256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f922e2528414a8383f14f28e6505c3d)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:49.714208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:49.796131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 878/1750] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:49.999286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:50.051501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f922e2528414a8383f14f28e6505c3d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:50.163999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f922e2528414a8383f14f28e6505c3d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:50.169360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f922e2528414a8383f14f28e6505c3d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:50.214351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f922e2528414a8383f14f28e6505c3d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:50.239352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f922e2528414a8383f14f28e6505c3d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:50.239352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 873/1751] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:28:49 2022] DELETE /identity/v3/users/9f922e2528414a8383f14f28e6505c3d => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:50.241494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8eef-b1f1-449f-b878-863a729bccb2 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:50.241819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8eef-b1f1-449f-b878-863a729bccb2 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:50.242121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8eef-b1f1-449f-b878-863a729bccb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:50.294336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-093e8eef-b1f1-449f-b878-863a729bccb2 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:50.295591 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-093e8eef-b1f1-449f-b878-863a729bccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:50.417969 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 879/1752] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:50.527315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:50.527315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:50.632608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e69f0-1ce9-4daf-b515-e655cc9a5d5f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:50.651799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d168a-f05d-47a5-b04d-8d7ea078d228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:50.652544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d168a-f05d-47a5-b04d-8d7ea078d228 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:50.653624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d168a-f05d-47a5-b04d-8d7ea078d228 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:50.655382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d168a-f05d-47a5-b04d-8d7ea078d228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:50.687163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d168a-f05d-47a5-b04d-8d7ea078d228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:50.689080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d168a-f05d-47a5-b04d-8d7ea078d228 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:50.712560 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 874/1753] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:51.388007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d29ecf-278c-4ad4-99c8-a9cdd5a7ed1b None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:51.399088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d29ecf-278c-4ad4-99c8-a9cdd5a7ed1b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:51.399503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d29ecf-278c-4ad4-99c8-a9cdd5a7ed1b None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:51.414068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 880/1754] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:28:51 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:28:51.482960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9646bb-359a-4813-b7c8-473ec2bd589c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:51.484405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9646bb-359a-4813-b7c8-473ec2bd589c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:51.486366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9646bb-359a-4813-b7c8-473ec2bd589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:51.534864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-0c9646bb-359a-4813-b7c8-473ec2bd589c None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:51.534864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0c9646bb-359a-4813-b7c8-473ec2bd589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:51.752879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 875/1755] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:28:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:52.075815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d29ecf-278c-4ad4-99c8-a9cdd5a7ed1b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:52.078127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-38d29ecf-278c-4ad4-99c8-a9cdd5a7ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:52.099431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d29ecf-278c-4ad4-99c8-a9cdd5a7ed1b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:52.105656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995704e-5218-43f7-a69e-fc5cef5430e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:52.106219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995704e-5218-43f7-a69e-fc5cef5430e0 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:52.106811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995704e-5218-43f7-a69e-fc5cef5430e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:52.107382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995704e-5218-43f7-a69e-fc5cef5430e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:52.117652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995704e-5218-43f7-a69e-fc5cef5430e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:52.119629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995704e-5218-43f7-a69e-fc5cef5430e0 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:52.142026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 881/1756] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:52.583534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9646bb-359a-4813-b7c8-473ec2bd589c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:52.585162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0c9646bb-359a-4813-b7c8-473ec2bd589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:52.644499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9646bb-359a-4813-b7c8-473ec2bd589c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:52.660177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:52.660953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:52.661375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:52.662021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] PATH_INFO: `/v3/projects/1eb2009c8df24519a6c9dcb8bd4e05b2` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:52.664201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb2009c8df24519a6c9dcb8bd4e05b2)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:52.672592 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:53.622024 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812ed82-159f-469d-86a6-f43b75c6de12 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:53.622704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812ed82-159f-469d-86a6-f43b75c6de12 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:53.622704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812ed82-159f-469d-86a6-f43b75c6de12 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:53.624339 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 882/1757] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:28:53.631848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a8b8f-0617-4ad3-a2ed-45615ac93245 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:53.632292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a8b8f-0617-4ad3-a2ed-45615ac93245 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:53.632574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a8b8f-0617-4ad3-a2ed-45615ac93245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:53.665368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-fc7a8b8f-0617-4ad3-a2ed-45615ac93245 None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:53.666622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fc7a8b8f-0617-4ad3-a2ed-45615ac93245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:53.677710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 883/1758] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:28:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:53.688795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a8b8f-0617-4ad3-a2ed-45615ac93245 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:53.699804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a8b8f-0617-4ad3-a2ed-45615ac93245 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:53.706240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e8245-4626-4be6-8380-cad55312612e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:53.706880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e8245-4626-4be6-8380-cad55312612e service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:53.707192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e8245-4626-4be6-8380-cad55312612e service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:53.707998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e8245-4626-4be6-8380-cad55312612e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:53.717191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e8245-4626-4be6-8380-cad55312612e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:53.718823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e8245-4626-4be6-8380-cad55312612e service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:53.730632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 884/1759] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:28:53.915867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb2009c8df24519a6c9dcb8bd4e05b2', 'request_id': 'req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:53.956856 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb2009c8df24519a6c9dcb8bd4e05b2', 'request_id': 'req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:54.169725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb2009c8df24519a6c9dcb8bd4e05b2', 'request_id': 'req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:54.188238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] The token cache is being invalidate because project 1eb2009c8df24519a6c9dcb8bd4e05b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:28:54.188650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:54.189354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:54.193510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 876/1760] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:28:52 2022] DELETE /identity/v3/projects/1eb2009c8df24519a6c9dcb8bd4e05b2 => generated 0 bytes in 1611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:54.197897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e8245-4626-4be6-8380-cad55312612e service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:54.215593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e8245-4626-4be6-8380-cad55312612e service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:54.366052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:54.366052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:54.366052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:54.366052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] PATH_INFO: `/v3/users/66e60c37738e4a3f915f9a9565771bfb` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:54.366380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e60c37738e4a3f915f9a9565771bfb)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:54.366380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:54.767961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:54.769500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:54.783204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ec41-e102-4729-9c9d-1b1bf8a78319 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:54.793757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:54.797429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:54.797429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:54.797429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] PATH_INFO: `/v3/users/4d312e03480b425cbe50df05e2315329` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:54.797429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d312e03480b425cbe50df05e2315329)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:54.798574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:55.057161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e60c37738e4a3f915f9a9565771bfb'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:55.058054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e60c37738e4a3f915f9a9565771bfb'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:55.058484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e60c37738e4a3f915f9a9565771bfb'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:55.210202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d312e03480b425cbe50df05e2315329'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:55.235116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e60c37738e4a3f915f9a9565771bfb'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:55.272441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4580d423-ce2d-419c-b462-a973b3c67618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e60c37738e4a3f915f9a9565771bfb'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:55.290554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 885/1761] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:28:54 2022] DELETE /identity/v3/users/66e60c37738e4a3f915f9a9565771bfb => generated 0 bytes in 1093 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:55.846066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d312e03480b425cbe50df05e2315329'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:55.847276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d312e03480b425cbe50df05e2315329'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:55.861474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d312e03480b425cbe50df05e2315329'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:55.861474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d312e03480b425cbe50df05e2315329'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:55.874397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 877/1762] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:28:54 2022] DELETE /identity/v3/users/4d312e03480b425cbe50df05e2315329 => generated 0 bytes in 1107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:28:55.878873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48daacc-f837-4817-86fa-5e7b69a96bc5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:55.879165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48daacc-f837-4817-86fa-5e7b69a96bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:55.879953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48daacc-f837-4817-86fa-5e7b69a96bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:55.899983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e48daacc-f837-4817-86fa-5e7b69a96bc5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:55.901215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e48daacc-f837-4817-86fa-5e7b69a96bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:55.991118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 886/1763] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:56.001662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:56.003224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:56.068540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dc5ee-c76f-4708-9277-73473249f4ec admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:56.072824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b8be9-1a52-47f5-abbf-fd8880818d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:56.073460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8be9-1a52-47f5-abbf-fd8880818d28 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:56.073783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8be9-1a52-47f5-abbf-fd8880818d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:56.074052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8be9-1a52-47f5-abbf-fd8880818d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:56.088032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b8be9-1a52-47f5-abbf-fd8880818d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:56.088032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b8be9-1a52-47f5-abbf-fd8880818d28 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:56.105018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 878/1764] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:56.623007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48daacc-f837-4817-86fa-5e7b69a96bc5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:56.623007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e48daacc-f837-4817-86fa-5e7b69a96bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:56.639259 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48daacc-f837-4817-86fa-5e7b69a96bc5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:56.662682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:56.662682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:56.662682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:56.662682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] PATH_INFO: `/v3/projects/651da7c80ab44a44a3313a4d8f0e4668` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:56.663325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] RBAC: Authorizing `identity:delete_project(project_id=651da7c80ab44a44a3313a4d8f0e4668)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:56.663325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:56.952224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651da7c80ab44a44a3313a4d8f0e4668', 'request_id': 'req-b633a421-818a-4770-9d53-8c02146d162f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:56.958809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651da7c80ab44a44a3313a4d8f0e4668', 'request_id': 'req-b633a421-818a-4770-9d53-8c02146d162f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:57.194090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651da7c80ab44a44a3313a4d8f0e4668', 'request_id': 'req-b633a421-818a-4770-9d53-8c02146d162f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:57.205813 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] The token cache is being invalidate because project 651da7c80ab44a44a3313a4d8f0e4668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:28:57.206455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:57.207127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:57.208665 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 887/1765] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:28:56 2022] DELETE /identity/v3/projects/651da7c80ab44a44a3313a4d8f0e4668 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:57.213646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8534972-e78b-4910-a174-4571af80dc2d None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.214325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8534972-e78b-4910-a174-4571af80dc2d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.214325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8534972-e78b-4910-a174-4571af80dc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.234473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a8534972-e78b-4910-a174-4571af80dc2d None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:57.235631 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a8534972-e78b-4910-a174-4571af80dc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:57.246906 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:57.248365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:57.299368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 879/1766] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:57.309326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e15e4-f6c2-4c00-83aa-b224d19718d5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.309326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e15e4-f6c2-4c00-83aa-b224d19718d5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.309511 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e15e4-f6c2-4c00-83aa-b224d19718d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.316591 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633a421-818a-4770-9d53-8c02146d162f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:57.322890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:57.323638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.324017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.324391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] PATH_INFO: `/v3/projects/04f146460ba54762961f942013a9d3c8` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.325657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f146460ba54762961f942013a9d3c8)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:57.327965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:57.344499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9f9e15e4-f6c2-4c00-83aa-b224d19718d5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:57.345869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9f9e15e4-f6c2-4c00-83aa-b224d19718d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:57.355779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 880/1767] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:57.361065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e15e4-f6c2-4c00-83aa-b224d19718d5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:57.372500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e15e4-f6c2-4c00-83aa-b224d19718d5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:57.379567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a9fb5-2880-4b19-bb36-6ba51205f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:57.380468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9fb5-2880-4b19-bb36-6ba51205f5dd admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.380830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9fb5-2880-4b19-bb36-6ba51205f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.381175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9fb5-2880-4b19-bb36-6ba51205f5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.381997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a9fb5-2880-4b19-bb36-6ba51205f5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:57.382377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a9fb5-2880-4b19-bb36-6ba51205f5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:57.384097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a9fb5-2880-4b19-bb36-6ba51205f5dd admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:57.398580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 881/1768] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:28:57.409538 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a9fb5-2880-4b19-bb36-6ba51205f5dd admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:57.420286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a9fb5-2880-4b19-bb36-6ba51205f5dd admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:57.425473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8d421-8070-4c62-807c-f72f9fd05990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:57.426141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8d421-8070-4c62-807c-f72f9fd05990 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.427009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8d421-8070-4c62-807c-f72f9fd05990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.427310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8d421-8070-4c62-807c-f72f9fd05990 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.427984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8d421-8070-4c62-807c-f72f9fd05990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:57.429993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8d421-8070-4c62-807c-f72f9fd05990 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:57.510467 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f146460ba54762961f942013a9d3c8', 'request_id': 'req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:57.516566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f146460ba54762961f942013a9d3c8', 'request_id': 'req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:57.622562 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f146460ba54762961f942013a9d3c8', 'request_id': 'req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:57.633714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 882/1769] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:57 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:28:57.634936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8d421-8070-4c62-807c-f72f9fd05990 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:57.635041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] The token cache is being invalidate because project 04f146460ba54762961f942013a9d3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:28:57.635487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:57.635909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1757ed51-ddd8-48d6-9b7d-d4785ecf7f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:57.637419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 888/1770] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:28:57 2022] DELETE /identity/v3/projects/04f146460ba54762961f942013a9d3c8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:57.641828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e94342-94b4-499b-b182-ebd736b61e1a None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.642137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e94342-94b4-499b-b182-ebd736b61e1a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.642411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e94342-94b4-499b-b182-ebd736b61e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.663086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-d5e94342-94b4-499b-b182-ebd736b61e1a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:57.664284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d5e94342-94b4-499b-b182-ebd736b61e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:57.701245 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8d421-8070-4c62-807c-f72f9fd05990 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:57.706811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa22852-69ae-43b0-9882-0c2590947935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:57.708068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa22852-69ae-43b0-9882-0c2590947935 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.708352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa22852-69ae-43b0-9882-0c2590947935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.708628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa22852-69ae-43b0-9882-0c2590947935 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.709319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa22852-69ae-43b0-9882-0c2590947935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:57.711246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa22852-69ae-43b0-9882-0c2590947935 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:57.725625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 889/1771] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:57.733363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697edf8-404c-4492-bfd0-53e0b147de68 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.733650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697edf8-404c-4492-bfd0-53e0b147de68 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.733957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697edf8-404c-4492-bfd0-53e0b147de68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.761730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-0697edf8-404c-4492-bfd0-53e0b147de68 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:57.761730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0697edf8-404c-4492-bfd0-53e0b147de68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:57.764126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 890/1772] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:57.768499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697edf8-404c-4492-bfd0-53e0b147de68 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:57.778405 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697edf8-404c-4492-bfd0-53e0b147de68 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:57.783333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d28fb-0ba6-4831-bbe4-b5f3ca87d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:57.784056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d28fb-0ba6-4831-bbe4-b5f3ca87d98e admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.784370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d28fb-0ba6-4831-bbe4-b5f3ca87d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.784710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d28fb-0ba6-4831-bbe4-b5f3ca87d98e admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.785438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d28fb-0ba6-4831-bbe4-b5f3ca87d98e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:28:57.786384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d28fb-0ba6-4831-bbe4-b5f3ca87d98e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:57.788156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d28fb-0ba6-4831-bbe4-b5f3ca87d98e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:57.800679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 891/1773] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:28:57.805142 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d28fb-0ba6-4831-bbe4-b5f3ca87d98e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:57.821864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d28fb-0ba6-4831-bbe4-b5f3ca87d98e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:57.828057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ac52f-307f-440f-94ba-01493b865b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:57.828686 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ac52f-307f-440f-94ba-01493b865b50 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.829118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ac52f-307f-440f-94ba-01493b865b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.829504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ac52f-307f-440f-94ba-01493b865b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.830129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ac52f-307f-440f-94ba-01493b865b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:57.833107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ac52f-307f-440f-94ba-01493b865b50 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:57.880263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 883/1774] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:57 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:57.881397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa22852-69ae-43b0-9882-0c2590947935 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:57.887380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3aa22852-69ae-43b0-9882-0c2590947935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:57.900126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa22852-69ae-43b0-9882-0c2590947935 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:57.905383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b473d-b951-464b-89ed-84cc98369f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:57.906058 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b473d-b951-464b-89ed-84cc98369f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.906347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b473d-b951-464b-89ed-84cc98369f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.906625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b473d-b951-464b-89ed-84cc98369f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.907273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b473d-b951-464b-89ed-84cc98369f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:57.908940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b473d-b951-464b-89ed-84cc98369f01 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:57.920118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 884/1775] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:57.924185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b473d-b951-464b-89ed-84cc98369f01 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:57.950436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b473d-b951-464b-89ed-84cc98369f01 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:57.957475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6dc3e-51c9-41bb-9533-235a0f79b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:57.962283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6dc3e-51c9-41bb-9533-235a0f79b4fd admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:57.962584 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6dc3e-51c9-41bb-9533-235a0f79b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:57.963557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6dc3e-51c9-41bb-9533-235a0f79b4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:57.963941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6dc3e-51c9-41bb-9533-235a0f79b4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:57.966940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6dc3e-51c9-41bb-9533-235a0f79b4fd admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:57.981019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 892/1776] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:57 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:28:57.984339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 885/1777] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:57.984577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ac52f-307f-440f-94ba-01493b865b50 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:57.990684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6dc3e-51c9-41bb-9533-235a0f79b4fd admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:58.005710 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6dc3e-51c9-41bb-9533-235a0f79b4fd admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:58.074369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ac52f-307f-440f-94ba-01493b865b50 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:58.079657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01893f-ddea-43df-a87c-bb7b6dbe7075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:58.080694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01893f-ddea-43df-a87c-bb7b6dbe7075 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:58.080694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01893f-ddea-43df-a87c-bb7b6dbe7075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:58.080900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01893f-ddea-43df-a87c-bb7b6dbe7075 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:58.081749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01893f-ddea-43df-a87c-bb7b6dbe7075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:58.082202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b6be8-15b1-41e0-9613-dea5bc634386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:58.083632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b6be8-15b1-41e0-9613-dea5bc634386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:58.084020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b6be8-15b1-41e0-9613-dea5bc634386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:58.084292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01893f-ddea-43df-a87c-bb7b6dbe7075 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:58.084484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b6be8-15b1-41e0-9613-dea5bc634386 admin admin] PATH_INFO: `/v3/projects/2c348cb083e442eea91ac08ed659d9af/users/8462dab11ea14e5cbf66da7c042fba95/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:58.101421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b6be8-15b1-41e0-9613-dea5bc634386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c348cb083e442eea91ac08ed659d9af, user_id=8462dab11ea14e5cbf66da7c042fba95, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:58.104117 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b6be8-15b1-41e0-9613-dea5bc634386 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:58.181191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:58.187371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 893/1778] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:57 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:28:58.191240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01893f-ddea-43df-a87c-bb7b6dbe7075 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:58.201532 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01893f-ddea-43df-a87c-bb7b6dbe7075 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:58.208727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0b9d-02fe-49bb-a9f7-9a875639bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:58.209331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0b9d-02fe-49bb-a9f7-9a875639bfcf admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:58.209609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0b9d-02fe-49bb-a9f7-9a875639bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:58.209916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0b9d-02fe-49bb-a9f7-9a875639bfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:58.210560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0b9d-02fe-49bb-a9f7-9a875639bfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:58.212146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0b9d-02fe-49bb-a9f7-9a875639bfcf admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:58.222316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 894/1779] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:28:58.238232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0b9d-02fe-49bb-a9f7-9a875639bfcf admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:58.248450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0b9d-02fe-49bb-a9f7-9a875639bfcf admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:58.253203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be516011-74d0-46e2-b80b-8216aaaca154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:58.253832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be516011-74d0-46e2-b80b-8216aaaca154 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:58.254117 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be516011-74d0-46e2-b80b-8216aaaca154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:58.255062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be516011-74d0-46e2-b80b-8216aaaca154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:58.255714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be516011-74d0-46e2-b80b-8216aaaca154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:58.257294 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be516011-74d0-46e2-b80b-8216aaaca154 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:58.269873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 886/1780] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:57 2022] PUT /identity/v3/projects/2c348cb083e442eea91ac08ed659d9af/users/8462dab11ea14e5cbf66da7c042fba95/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:58.270356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 895/1781] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:28:58.273381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b6be8-15b1-41e0-9613-dea5bc634386 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:58.278563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a71f9-7ef3-45a6-a197-b101e598bfcd None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:58.278921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a71f9-7ef3-45a6-a197-b101e598bfcd None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:58.279206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a71f9-7ef3-45a6-a197-b101e598bfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:58.307909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-953a71f9-7ef3-45a6-a197-b101e598bfcd None None] MFA Rules not processed for user `8462dab11ea14e5cbf66da7c042fba95`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:58.310067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-953a71f9-7ef3-45a6-a197-b101e598bfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:58.335068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b6be8-15b1-41e0-9613-dea5bc634386 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:58.339835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13179f95-4855-4b32-bd2e-e6bfb7969646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:58.340488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179f95-4855-4b32-bd2e-e6bfb7969646 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:58.340766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179f95-4855-4b32-bd2e-e6bfb7969646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:58.344380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13179f95-4855-4b32-bd2e-e6bfb7969646 admin admin] PATH_INFO: `/v3/projects/a2c48a37353747c0bc1ccd5019c1e8a6/users/7b853cb6282049d1b526e62412549c19/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:58.356050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179f95-4855-4b32-bd2e-e6bfb7969646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c48a37353747c0bc1ccd5019c1e8a6, user_id=7b853cb6282049d1b526e62412549c19, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:58.358735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13179f95-4855-4b32-bd2e-e6bfb7969646 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:58.372803 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 896/1782] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:58.377289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a71f9-7ef3-45a6-a197-b101e598bfcd None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:58.387873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a71f9-7ef3-45a6-a197-b101e598bfcd None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:58.392448 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2227343-1635-45e5-b143-8028f100155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:58.393047 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2227343-1635-45e5-b143-8028f100155e admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:58.393327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2227343-1635-45e5-b143-8028f100155e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:58.393599 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2227343-1635-45e5-b143-8028f100155e admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:58.394276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2227343-1635-45e5-b143-8028f100155e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:58.396188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2227343-1635-45e5-b143-8028f100155e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:58.642309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 887/1783] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:58 2022] PUT /identity/v3/projects/a2c48a37353747c0bc1ccd5019c1e8a6/users/7b853cb6282049d1b526e62412549c19/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:58.670571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76419-7e27-491c-8383-00a19f0039f1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:58.670571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76419-7e27-491c-8383-00a19f0039f1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:58.670571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a76419-7e27-491c-8383-00a19f0039f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:58.681828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-06a76419-7e27-491c-8383-00a19f0039f1 None None] MFA Rules not processed for user `7b853cb6282049d1b526e62412549c19`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:58.683062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-06a76419-7e27-491c-8383-00a19f0039f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:58.725071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 897/1784] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:58 2022] POST /identity/v3/projects => generated 383 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:28:58.750592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2227343-1635-45e5-b143-8028f100155e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:58.750727 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 888/1785] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:28:58.753523 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a76419-7e27-491c-8383-00a19f0039f1 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:58.787640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2227343-1635-45e5-b143-8028f100155e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:58.792145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0371c1-8b36-472b-9359-b29a5516a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:58.792780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0371c1-8b36-472b-9359-b29a5516a117 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:58.793065 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0371c1-8b36-472b-9359-b29a5516a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:58.793342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0371c1-8b36-472b-9359-b29a5516a117 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:58.794014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0371c1-8b36-472b-9359-b29a5516a117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:58.796037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0371c1-8b36-472b-9359-b29a5516a117 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:58.816233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a76419-7e27-491c-8383-00a19f0039f1 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:58.821143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e44c7-fe81-44cc-b431-e2b94af41fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:58.821793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e44c7-fe81-44cc-b431-e2b94af41fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:58.822077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e44c7-fe81-44cc-b431-e2b94af41fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:58.822358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e44c7-fe81-44cc-b431-e2b94af41fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:58.823005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e44c7-fe81-44cc-b431-e2b94af41fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:58.825026 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e44c7-fe81-44cc-b431-e2b94af41fb5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:59.087331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 898/1786] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:58 2022] POST /identity/v3/users => generated 298 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:28:59.088267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0371c1-8b36-472b-9359-b29a5516a117 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:59.088391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 889/1787] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:28:58 2022] POST /identity/v3/projects => generated 367 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:28:59.090795 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e44c7-fe81-44cc-b431-e2b94af41fb5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:59.093382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fd0371c1-8b36-472b-9359-b29a5516a117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:59.125071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0371c1-8b36-472b-9359-b29a5516a117 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:59.163014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e44c7-fe81-44cc-b431-e2b94af41fb5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:59.169169 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055c873-9d2b-4930-b75b-f2654ed5ef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:59.169978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055c873-9d2b-4930-b75b-f2654ed5ef4a admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:59.170361 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055c873-9d2b-4930-b75b-f2654ed5ef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:59.170741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055c873-9d2b-4930-b75b-f2654ed5ef4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:59.171623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055c873-9d2b-4930-b75b-f2654ed5ef4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:59.173201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055c873-9d2b-4930-b75b-f2654ed5ef4a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:59.184077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 890/1788] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:59.185036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055c873-9d2b-4930-b75b-f2654ed5ef4a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:59.196309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055c873-9d2b-4930-b75b-f2654ed5ef4a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:59.200033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:59.200811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:59.201092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:59.201365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] PATH_INFO: `/v3/users/b3700845fb13491ebae9277b33c00113` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:59.201525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e298c-4f0d-4d50-afa9-333bedf2fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:59.202254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e298c-4f0d-4d50-afa9-333bedf2fd09 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:59.202669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3700845fb13491ebae9277b33c00113)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:59.202781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e298c-4f0d-4d50-afa9-333bedf2fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:59.204488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e298c-4f0d-4d50-afa9-333bedf2fd09 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:59.204488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e298c-4f0d-4d50-afa9-333bedf2fd09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:59.205902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e298c-4f0d-4d50-afa9-333bedf2fd09 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:59.206279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:59.431267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 891/1789] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:28:59 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:28:59.431267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e298c-4f0d-4d50-afa9-333bedf2fd09 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:59.441186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e298c-4f0d-4d50-afa9-333bedf2fd09 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:59.446651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3c3dc-d6bf-4358-bea6-034bfd8d4a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:59.447335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3c3dc-d6bf-4358-bea6-034bfd8d4a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:59.447646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3c3dc-d6bf-4358-bea6-034bfd8d4a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:59.447931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3c3dc-d6bf-4358-bea6-034bfd8d4a72 admin admin] PATH_INFO: `/v3/projects/5a44d3ade5ec44f4a41af7e1605fee7b/users/5df951dbe842405698afac51c08cd14e/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:59.464220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3c3dc-d6bf-4358-bea6-034bfd8d4a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a44d3ade5ec44f4a41af7e1605fee7b, user_id=5df951dbe842405698afac51c08cd14e, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:59.467287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3c3dc-d6bf-4358-bea6-034bfd8d4a72 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:59.614267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 892/1790] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:59 2022] PUT /identity/v3/projects/5a44d3ade5ec44f4a41af7e1605fee7b/users/5df951dbe842405698afac51c08cd14e/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:59.617383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3c3dc-d6bf-4358-bea6-034bfd8d4a72 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:59.625382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3700845fb13491ebae9277b33c00113'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:59.626225 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3700845fb13491ebae9277b33c00113'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:59.626859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3700845fb13491ebae9277b33c00113'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:59.688967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3c3dc-d6bf-4358-bea6-034bfd8d4a72 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:59.693595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c14cf-b176-4e80-a230-c1341a4c0768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:59.694223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c14cf-b176-4e80-a230-c1341a4c0768 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:59.694503 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c14cf-b176-4e80-a230-c1341a4c0768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:59.694779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c14cf-b176-4e80-a230-c1341a4c0768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:59.695419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c14cf-b176-4e80-a230-c1341a4c0768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:59.696991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c14cf-b176-4e80-a230-c1341a4c0768 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:59.707300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 893/1791] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:59.708781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c14cf-b176-4e80-a230-c1341a4c0768 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:59.710659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e00c14cf-b176-4e80-a230-c1341a4c0768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:59.723888 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c14cf-b176-4e80-a230-c1341a4c0768 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:59.728551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10c2b7-9d06-49fd-9d51-7d6f2cbad398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:59.729141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10c2b7-9d06-49fd-9d51-7d6f2cbad398 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:59.729422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10c2b7-9d06-49fd-9d51-7d6f2cbad398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:59.729718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10c2b7-9d06-49fd-9d51-7d6f2cbad398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:59.730358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10c2b7-9d06-49fd-9d51-7d6f2cbad398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:59.731929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10c2b7-9d06-49fd-9d51-7d6f2cbad398 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:59.742267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 894/1792] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:28:59.743155 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10c2b7-9d06-49fd-9d51-7d6f2cbad398 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:59.744753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0a10c2b7-9d06-49fd-9d51-7d6f2cbad398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:59.759287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10c2b7-9d06-49fd-9d51-7d6f2cbad398 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:59.763988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260b511-1196-4151-868b-91f8d4a49138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:59.764650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260b511-1196-4151-868b-91f8d4a49138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:59.764930 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260b511-1196-4151-868b-91f8d4a49138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:59.765237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260b511-1196-4151-868b-91f8d4a49138 admin admin] PATH_INFO: `/v3/projects/5c754d1c15b1450db2f13ef8880166d0/users/c342de73d5414d1aa65110da272c7b9e/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:59.780952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260b511-1196-4151-868b-91f8d4a49138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c754d1c15b1450db2f13ef8880166d0, user_id=c342de73d5414d1aa65110da272c7b9e, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:59.783800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260b511-1196-4151-868b-91f8d4a49138 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:59.802509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3700845fb13491ebae9277b33c00113'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:59.814802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3700845fb13491ebae9277b33c00113'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:59.827995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 899/1793] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:28:59 2022] DELETE /identity/v3/users/b3700845fb13491ebae9277b33c00113 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:59.828798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:59.890572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f045a-d1f6-4f58-b208-2b2932e98c88 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:59.898863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed8742-a37f-40e5-bb73-bdf5cb80a8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:59.899584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8742-a37f-40e5-bb73-bdf5cb80a8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:59.899871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8742-a37f-40e5-bb73-bdf5cb80a8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:59.900146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8742-a37f-40e5-bb73-bdf5cb80a8b7 admin admin] PATH_INFO: `/v3/projects/5a44d3ade5ec44f4a41af7e1605fee7b/users/5df951dbe842405698afac51c08cd14e/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:59.902347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed8742-a37f-40e5-bb73-bdf5cb80a8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a44d3ade5ec44f4a41af7e1605fee7b, user_id=5df951dbe842405698afac51c08cd14e, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:59.905063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed8742-a37f-40e5-bb73-bdf5cb80a8b7 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:59.916860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 900/1794] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:59 2022] PUT /identity/v3/projects/5a44d3ade5ec44f4a41af7e1605fee7b/users/5df951dbe842405698afac51c08cd14e/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:59.929331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0099d-1a57-47e4-83ea-b2c4f42a4211 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:59.929626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0099d-1a57-47e4-83ea-b2c4f42a4211 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:59.929930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0099d-1a57-47e4-83ea-b2c4f42a4211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:59.958407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-35a0099d-1a57-47e4-83ea-b2c4f42a4211 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:59.963827 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-35a0099d-1a57-47e4-83ea-b2c4f42a4211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:59.995057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 895/1795] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:28:59 2022] PUT /identity/v3/projects/5c754d1c15b1450db2f13ef8880166d0/users/c342de73d5414d1aa65110da272c7b9e/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:59.999131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350230d5-1f29-4a3d-acca-939190ba2194 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:00.001772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350230d5-1f29-4a3d-acca-939190ba2194 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:00.002170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350230d5-1f29-4a3d-acca-939190ba2194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:00.036502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-350230d5-1f29-4a3d-acca-939190ba2194 None None] MFA Rules not processed for user `5df951dbe842405698afac51c08cd14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:00.041693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-350230d5-1f29-4a3d-acca-939190ba2194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:00.042781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 901/1796] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:00.043732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0099d-1a57-47e4-83ea-b2c4f42a4211 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:00.054446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0099d-1a57-47e4-83ea-b2c4f42a4211 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:00.130698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 896/1797] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:28:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:00.133967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350230d5-1f29-4a3d-acca-939190ba2194 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:00.135507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-350230d5-1f29-4a3d-acca-939190ba2194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:00.182604 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398b4be-897b-4d5a-be92-095e6342f6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:00.183285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398b4be-897b-4d5a-be92-095e6342f6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:00.183570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398b4be-897b-4d5a-be92-095e6342f6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:00.183845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398b4be-897b-4d5a-be92-095e6342f6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:00.184689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398b4be-897b-4d5a-be92-095e6342f6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:00.186628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398b4be-897b-4d5a-be92-095e6342f6a3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:00.198934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 902/1798] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:00.204581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398b4be-897b-4d5a-be92-095e6342f6a3 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:00.206995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f398b4be-897b-4d5a-be92-095e6342f6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:00.258944 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350230d5-1f29-4a3d-acca-939190ba2194 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:00.264023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e134076-04af-473b-a9b2-b3ff88a3e847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:00.264988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e134076-04af-473b-a9b2-b3ff88a3e847 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:00.265276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e134076-04af-473b-a9b2-b3ff88a3e847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:00.266373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e134076-04af-473b-a9b2-b3ff88a3e847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:00.277601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e134076-04af-473b-a9b2-b3ff88a3e847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:00.279725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e134076-04af-473b-a9b2-b3ff88a3e847 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:00.296630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 897/1799] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:00.297557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e134076-04af-473b-a9b2-b3ff88a3e847 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:00.310699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e134076-04af-473b-a9b2-b3ff88a3e847 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:00.317172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612dd23-0607-42ca-9d0b-611d9ebde257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:00.317910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612dd23-0607-42ca-9d0b-611d9ebde257 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:00.318197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612dd23-0607-42ca-9d0b-611d9ebde257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:00.318483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612dd23-0607-42ca-9d0b-611d9ebde257 admin admin] PATH_INFO: `/v3/projects/5c754d1c15b1450db2f13ef8880166d0/users/c342de73d5414d1aa65110da272c7b9e/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:00.320702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612dd23-0607-42ca-9d0b-611d9ebde257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c754d1c15b1450db2f13ef8880166d0, user_id=c342de73d5414d1aa65110da272c7b9e, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:00.323853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612dd23-0607-42ca-9d0b-611d9ebde257 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:00.350119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 898/1800] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:00 2022] PUT /identity/v3/projects/5c754d1c15b1450db2f13ef8880166d0/users/c342de73d5414d1aa65110da272c7b9e/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:00.360229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398b4be-897b-4d5a-be92-095e6342f6a3 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:00.372284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d94e-028f-4a7f-b1ae-791ed3791a23 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:00.376165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d94e-028f-4a7f-b1ae-791ed3791a23 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:00.376537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d94e-028f-4a7f-b1ae-791ed3791a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:00.435635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3427d94e-028f-4a7f-b1ae-791ed3791a23 None None] MFA Rules not processed for user `c342de73d5414d1aa65110da272c7b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:00.438179 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3427d94e-028f-4a7f-b1ae-791ed3791a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:00.440000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6e264-e1f8-4952-bb5e-66ef24625b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:00.440854 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6e264-e1f8-4952-bb5e-66ef24625b9b service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:00.441341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6e264-e1f8-4952-bb5e-66ef24625b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:00.442878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6e264-e1f8-4952-bb5e-66ef24625b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:00.535957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6e264-e1f8-4952-bb5e-66ef24625b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:00.538026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6e264-e1f8-4952-bb5e-66ef24625b9b service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:00.547872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 899/1801] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:00.554248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 903/1802] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:00.555800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427d94e-028f-4a7f-b1ae-791ed3791a23 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:00.559028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3427d94e-028f-4a7f-b1ae-791ed3791a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:00.577786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427d94e-028f-4a7f-b1ae-791ed3791a23 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:00.584487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa5687-068b-4615-9a68-b8d0c8b02ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:00.585632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa5687-068b-4615-9a68-b8d0c8b02ebc service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:00.586277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa5687-068b-4615-9a68-b8d0c8b02ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:00.586749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa5687-068b-4615-9a68-b8d0c8b02ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:00.601483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa5687-068b-4615-9a68-b8d0c8b02ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:00.603834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa5687-068b-4615-9a68-b8d0c8b02ebc service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:00.700045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 900/1803] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:00.757344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6e264-e1f8-4952-bb5e-66ef24625b9b service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:00.769209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6e264-e1f8-4952-bb5e-66ef24625b9b service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:00.775027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98892-91ce-45e7-82d1-13e604eb245a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:00.776372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98892-91ce-45e7-82d1-13e604eb245a service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:00.776882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98892-91ce-45e7-82d1-13e604eb245a service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:00.777383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98892-91ce-45e7-82d1-13e604eb245a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:00.779966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-75b98892-91ce-45e7-82d1-13e604eb245a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:00.867203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98892-91ce-45e7-82d1-13e604eb245a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:00.868760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98892-91ce-45e7-82d1-13e604eb245a service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:00.879334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 904/1804] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:00.923959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa5687-068b-4615-9a68-b8d0c8b02ebc service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:00.940177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa5687-068b-4615-9a68-b8d0c8b02ebc service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:00.945700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38278c6b-7aaa-495d-846d-e50788ebb0e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:00.945847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38278c6b-7aaa-495d-846d-e50788ebb0e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:00.946682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38278c6b-7aaa-495d-846d-e50788ebb0e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:00.946982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38278c6b-7aaa-495d-846d-e50788ebb0e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:00.950285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-38278c6b-7aaa-495d-846d-e50788ebb0e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:01.126326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38278c6b-7aaa-495d-846d-e50788ebb0e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:01.127799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38278c6b-7aaa-495d-846d-e50788ebb0e2 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:01.154728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 901/1805] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:01.834052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98892-91ce-45e7-82d1-13e604eb245a service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:01.835834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-75b98892-91ce-45e7-82d1-13e604eb245a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:01.901949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98892-91ce-45e7-82d1-13e604eb245a service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:01.906547 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:01.907175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:01.907454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:01.907730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] PATH_INFO: `/v3/projects/03ff639ad8cc47ae952f8ffd97d6be34` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:01.908847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ff639ad8cc47ae952f8ffd97d6be34)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:01.910848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:02.090187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ff639ad8cc47ae952f8ffd97d6be34', 'request_id': 'req-52491f12-00d2-4573-b3e7-2451827ebbf2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:02.096558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ff639ad8cc47ae952f8ffd97d6be34', 'request_id': 'req-52491f12-00d2-4573-b3e7-2451827ebbf2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:02.185236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ff639ad8cc47ae952f8ffd97d6be34', 'request_id': 'req-52491f12-00d2-4573-b3e7-2451827ebbf2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:02.204347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] The token cache is being invalidate because project 03ff639ad8cc47ae952f8ffd97d6be34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:02.204646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:02.206437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:02.214673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 905/1806] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:01 2022] DELETE /identity/v3/projects/03ff639ad8cc47ae952f8ffd97d6be34 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:02.215430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38278c6b-7aaa-495d-846d-e50788ebb0e2 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:02.230260 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38278c6b-7aaa-495d-846d-e50788ebb0e2 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:02.268958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:02.301297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:02.302339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:02.302622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:02.302896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] PATH_INFO: `/v3/users/78e7d42c62b74daa83fee1cff8a43e4e` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:02.304041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e7d42c62b74daa83fee1cff8a43e4e)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:02.306068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:02.561106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e7d42c62b74daa83fee1cff8a43e4e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:02.711085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e7d42c62b74daa83fee1cff8a43e4e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:02.712198 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e7d42c62b74daa83fee1cff8a43e4e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:02.726679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e7d42c62b74daa83fee1cff8a43e4e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:02.726679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3725ef5a-b8b4-43bb-8192-bb4b091109a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e7d42c62b74daa83fee1cff8a43e4e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:02.739851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 902/1807] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:02 2022] DELETE /identity/v3/users/78e7d42c62b74daa83fee1cff8a43e4e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:03.470812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:03.472350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:03.496920 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52491f12-00d2-4573-b3e7-2451827ebbf2 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:03.564420 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:03.565066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:03.565497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:03.566270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] PATH_INFO: `/v3/projects/b6e9f318c9314c51bbf6f9cd623b79d5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:03.568512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e9f318c9314c51bbf6f9cd623b79d5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:03.571232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:03.806197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e9f318c9314c51bbf6f9cd623b79d5', 'request_id': 'req-f1060704-0967-4116-b8a8-b083958b5bfc'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:03.814581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e9f318c9314c51bbf6f9cd623b79d5', 'request_id': 'req-f1060704-0967-4116-b8a8-b083958b5bfc'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:03.956582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e9f318c9314c51bbf6f9cd623b79d5', 'request_id': 'req-f1060704-0967-4116-b8a8-b083958b5bfc'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:03.968080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] The token cache is being invalidate because project b6e9f318c9314c51bbf6f9cd623b79d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:03.968369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:03.969005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f1060704-0967-4116-b8a8-b083958b5bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:03.970580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 906/1808] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:03 2022] DELETE /identity/v3/projects/b6e9f318c9314c51bbf6f9cd623b79d5 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:03.975911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144d25f-7ed1-4156-88f3-b7e4a08541f7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:03.976371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144d25f-7ed1-4156-88f3-b7e4a08541f7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:03.976478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144d25f-7ed1-4156-88f3-b7e4a08541f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:03.996665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-f144d25f-7ed1-4156-88f3-b7e4a08541f7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:03.998436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f144d25f-7ed1-4156-88f3-b7e4a08541f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:04.056777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 903/1809] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:04.065963 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef88d93-2ecb-4a70-909a-9ec3203d7bd0 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:04.066257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef88d93-2ecb-4a70-909a-9ec3203d7bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:04.066546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef88d93-2ecb-4a70-909a-9ec3203d7bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:04.086339 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4ef88d93-2ecb-4a70-909a-9ec3203d7bd0 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:04.087538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4ef88d93-2ecb-4a70-909a-9ec3203d7bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:04.095266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 907/1810] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:04.099940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144d25f-7ed1-4156-88f3-b7e4a08541f7 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:04.109435 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144d25f-7ed1-4156-88f3-b7e4a08541f7 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:04.114602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc0e7-801a-4106-86c6-fd0c2cbf703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:04.115218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc0e7-801a-4106-86c6-fd0c2cbf703f admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:04.115545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc0e7-801a-4106-86c6-fd0c2cbf703f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:04.115823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc0e7-801a-4106-86c6-fd0c2cbf703f admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:04.116476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebc0e7-801a-4106-86c6-fd0c2cbf703f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:04.116772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebc0e7-801a-4106-86c6-fd0c2cbf703f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:04.118436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebc0e7-801a-4106-86c6-fd0c2cbf703f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:04.130228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 904/1811] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:04.134603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef88d93-2ecb-4a70-909a-9ec3203d7bd0 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:04.143822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef88d93-2ecb-4a70-909a-9ec3203d7bd0 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:04.148486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b078932-044d-4660-a02b-5562a0d8edc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:04.180743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b078932-044d-4660-a02b-5562a0d8edc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:04.180743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b078932-044d-4660-a02b-5562a0d8edc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:04.180743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b078932-044d-4660-a02b-5562a0d8edc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:04.180743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b078932-044d-4660-a02b-5562a0d8edc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:04.180743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b078932-044d-4660-a02b-5562a0d8edc8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:04.271694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 908/1812] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:04 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:04.281732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc0e7-801a-4106-86c6-fd0c2cbf703f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:04.291936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc0e7-801a-4106-86c6-fd0c2cbf703f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:04.351161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ab241-bd9f-4ca3-af7d-e0ef9a31a5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:04.351693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ab241-bd9f-4ca3-af7d-e0ef9a31a5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:04.351974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ab241-bd9f-4ca3-af7d-e0ef9a31a5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:04.352312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ab241-bd9f-4ca3-af7d-e0ef9a31a5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:04.353861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ab241-bd9f-4ca3-af7d-e0ef9a31a5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:04.355972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ab241-bd9f-4ca3-af7d-e0ef9a31a5b6 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:04.523524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 905/1813] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:04 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:04.527523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b078932-044d-4660-a02b-5562a0d8edc8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:04.540627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b078932-044d-4660-a02b-5562a0d8edc8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:04.547881 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34880b76-684c-4ec2-b566-126abecb3853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:04.552887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34880b76-684c-4ec2-b566-126abecb3853 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:04.552887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34880b76-684c-4ec2-b566-126abecb3853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:04.552887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34880b76-684c-4ec2-b566-126abecb3853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:04.552887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34880b76-684c-4ec2-b566-126abecb3853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:04.552887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34880b76-684c-4ec2-b566-126abecb3853 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:04.564163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 909/1814] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:04.568413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ab241-bd9f-4ca3-af7d-e0ef9a31a5b6 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:04.581825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ab241-bd9f-4ca3-af7d-e0ef9a31a5b6 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:04.587618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e769c-da09-43d7-89a1-4fcf416d7a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:04.588241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e769c-da09-43d7-89a1-4fcf416d7a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:04.588528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e769c-da09-43d7-89a1-4fcf416d7a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:04.588805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e769c-da09-43d7-89a1-4fcf416d7a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:04.589569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e769c-da09-43d7-89a1-4fcf416d7a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:04.591389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e769c-da09-43d7-89a1-4fcf416d7a36 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:04.604433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 906/1815] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:04.608260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34880b76-684c-4ec2-b566-126abecb3853 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:04.623940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34880b76-684c-4ec2-b566-126abecb3853 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:04.630636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629c85-e9f6-402d-a7c0-dda6d70f2321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:04.631428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629c85-e9f6-402d-a7c0-dda6d70f2321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:04.631832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629c85-e9f6-402d-a7c0-dda6d70f2321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:04.632236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629c85-e9f6-402d-a7c0-dda6d70f2321 admin admin] PATH_INFO: `/v3/projects/956f2b2d41ec4c93ac3ebb77e7382e7c/users/45ecab6e4bc14f9e8f17c31b6647bdd4/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:04.648600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc629c85-e9f6-402d-a7c0-dda6d70f2321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956f2b2d41ec4c93ac3ebb77e7382e7c, user_id=45ecab6e4bc14f9e8f17c31b6647bdd4, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:04.651437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc629c85-e9f6-402d-a7c0-dda6d70f2321 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:04.677772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:04.760745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 910/1816] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:04 2022] PUT /identity/v3/projects/956f2b2d41ec4c93ac3ebb77e7382e7c/users/45ecab6e4bc14f9e8f17c31b6647bdd4/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:04.772638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d49d88-40d8-4a03-8dfe-8640614e335e None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:04.773016 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d49d88-40d8-4a03-8dfe-8640614e335e None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:04.773304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d49d88-40d8-4a03-8dfe-8640614e335e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:04.809579 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-07d49d88-40d8-4a03-8dfe-8640614e335e None None] MFA Rules not processed for user `45ecab6e4bc14f9e8f17c31b6647bdd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:04.810883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-07d49d88-40d8-4a03-8dfe-8640614e335e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:04.923657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 907/1817] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:04.928982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629c85-e9f6-402d-a7c0-dda6d70f2321 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:05.041140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629c85-e9f6-402d-a7c0-dda6d70f2321 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:05.046291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daec88e-3b7c-45e9-8eca-d439676930b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:05.046936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daec88e-3b7c-45e9-8eca-d439676930b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:05.047220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daec88e-3b7c-45e9-8eca-d439676930b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:05.047495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daec88e-3b7c-45e9-8eca-d439676930b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:05.048142 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daec88e-3b7c-45e9-8eca-d439676930b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:05.050169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daec88e-3b7c-45e9-8eca-d439676930b2 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:05.167307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 911/1818] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:04 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:05.167911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d49d88-40d8-4a03-8dfe-8640614e335e None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:05.179606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d49d88-40d8-4a03-8dfe-8640614e335e None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:05.234671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bd089-b466-4957-8817-c91a4d2c7b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:05.235206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bd089-b466-4957-8817-c91a4d2c7b4e admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:05.235489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bd089-b466-4957-8817-c91a4d2c7b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:05.235766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bd089-b466-4957-8817-c91a4d2c7b4e admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:05.236418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bd089-b466-4957-8817-c91a4d2c7b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:05.238395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bd089-b466-4957-8817-c91a4d2c7b4e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:05.381982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 908/1819] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:05 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:05.386414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daec88e-3b7c-45e9-8eca-d439676930b2 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:05.397539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daec88e-3b7c-45e9-8eca-d439676930b2 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:05.406871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e4164-8cce-4ec1-a5f6-52dafc61807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:05.407514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e4164-8cce-4ec1-a5f6-52dafc61807f admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:05.407792 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e4164-8cce-4ec1-a5f6-52dafc61807f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:05.408063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e4164-8cce-4ec1-a5f6-52dafc61807f admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:05.408708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e4164-8cce-4ec1-a5f6-52dafc61807f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:05.410525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e4164-8cce-4ec1-a5f6-52dafc61807f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:05.426932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 912/1820] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:05.430829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bd089-b466-4957-8817-c91a4d2c7b4e admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:05.440850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bd089-b466-4957-8817-c91a4d2c7b4e admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:05.446104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01354c81-a35b-4e11-a90b-3c4f43f6691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:05.446833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354c81-a35b-4e11-a90b-3c4f43f6691e admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:05.447149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354c81-a35b-4e11-a90b-3c4f43f6691e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:05.447426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354c81-a35b-4e11-a90b-3c4f43f6691e admin admin] PATH_INFO: `/v3/projects/c295809b5ab246eea834fb3de9c8bf59/users/d40dceb6c8cc4ccc99e707f5a97824e0/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:05.467808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01354c81-a35b-4e11-a90b-3c4f43f6691e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c295809b5ab246eea834fb3de9c8bf59, user_id=d40dceb6c8cc4ccc99e707f5a97824e0, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:05.467808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01354c81-a35b-4e11-a90b-3c4f43f6691e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:05.628922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 909/1821] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:05 2022] PUT /identity/v3/projects/c295809b5ab246eea834fb3de9c8bf59/users/d40dceb6c8cc4ccc99e707f5a97824e0/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:05.633013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e4164-8cce-4ec1-a5f6-52dafc61807f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:05.643335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e4164-8cce-4ec1-a5f6-52dafc61807f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:05.699930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b991b4a-0cc8-4db0-87cf-406a28aba00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:05.700585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b991b4a-0cc8-4db0-87cf-406a28aba00d admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:05.700870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b991b4a-0cc8-4db0-87cf-406a28aba00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:05.701155 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b991b4a-0cc8-4db0-87cf-406a28aba00d admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:05.701848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b991b4a-0cc8-4db0-87cf-406a28aba00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:05.703571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b991b4a-0cc8-4db0-87cf-406a28aba00d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:05.715453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 913/1822] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:05.719542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01354c81-a35b-4e11-a90b-3c4f43f6691e admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:05.731180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01354c81-a35b-4e11-a90b-3c4f43f6691e admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:05.735939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05819f1-624c-4e80-9530-2bc119ccdf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:05.736637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05819f1-624c-4e80-9530-2bc119ccdf6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:05.736923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05819f1-624c-4e80-9530-2bc119ccdf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:05.737205 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05819f1-624c-4e80-9530-2bc119ccdf6a admin admin] PATH_INFO: `/v3/projects/c295809b5ab246eea834fb3de9c8bf59/users/d40dceb6c8cc4ccc99e707f5a97824e0/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:05.739233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05819f1-624c-4e80-9530-2bc119ccdf6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c295809b5ab246eea834fb3de9c8bf59, user_id=d40dceb6c8cc4ccc99e707f5a97824e0, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:05.741914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05819f1-624c-4e80-9530-2bc119ccdf6a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:05.754042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 910/1823] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:05 2022] PUT /identity/v3/projects/c295809b5ab246eea834fb3de9c8bf59/users/d40dceb6c8cc4ccc99e707f5a97824e0/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:05.765805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6f480-e095-4dbb-91a5-9a73d0a5c68d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:05.766185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6f480-e095-4dbb-91a5-9a73d0a5c68d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:05.766560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6f480-e095-4dbb-91a5-9a73d0a5c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:05.795414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-85d6f480-e095-4dbb-91a5-9a73d0a5c68d None None] MFA Rules not processed for user `d40dceb6c8cc4ccc99e707f5a97824e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:05.796541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-85d6f480-e095-4dbb-91a5-9a73d0a5c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:05.829409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05819f1-624c-4e80-9530-2bc119ccdf6a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:05.838373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c05819f1-624c-4e80-9530-2bc119ccdf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:05.897865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 914/1824] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:05.910428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6f480-e095-4dbb-91a5-9a73d0a5c68d None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:05.913446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-85d6f480-e095-4dbb-91a5-9a73d0a5c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:05.913771 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05819f1-624c-4e80-9530-2bc119ccdf6a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:05.918716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:05.919381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:05.919665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:05.919938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] PATH_INFO: `/v3/users/8462dab11ea14e5cbf66da7c042fba95` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:05.921401 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8462dab11ea14e5cbf66da7c042fba95)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:05.923647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:05.980578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6f480-e095-4dbb-91a5-9a73d0a5c68d None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:05.986387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab95be-8fe9-4e35-a267-74ee4adde738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:05.987039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab95be-8fe9-4e35-a267-74ee4adde738 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:05.989110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab95be-8fe9-4e35-a267-74ee4adde738 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:05.989110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab95be-8fe9-4e35-a267-74ee4adde738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:06.058352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab95be-8fe9-4e35-a267-74ee4adde738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:06.059802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab95be-8fe9-4e35-a267-74ee4adde738 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:06.069901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 915/1825] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:06.199592 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8462dab11ea14e5cbf66da7c042fba95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:06.450433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8462dab11ea14e5cbf66da7c042fba95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:06.460861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8462dab11ea14e5cbf66da7c042fba95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:06.476939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8462dab11ea14e5cbf66da7c042fba95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:06.477704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8462dab11ea14e5cbf66da7c042fba95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:06.491297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 911/1826] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:05 2022] DELETE /identity/v3/users/8462dab11ea14e5cbf66da7c042fba95 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:06.496049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5822a8-2923-4217-99e7-101fbb3aa05b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:06.496322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5822a8-2923-4217-99e7-101fbb3aa05b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:06.496675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5822a8-2923-4217-99e7-101fbb3aa05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:06.516966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-0d5822a8-2923-4217-99e7-101fbb3aa05b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:06.518286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0d5822a8-2923-4217-99e7-101fbb3aa05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:06.584829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 916/1827] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:06.595459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:06.596900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:06.655170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a9f21-7c4f-409e-bc99-90909c44f6d9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:06.658893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5de7d-fd80-477a-8cd8-49c1bdcfc92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:06.659544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5de7d-fd80-477a-8cd8-49c1bdcfc92a service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:06.659823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5de7d-fd80-477a-8cd8-49c1bdcfc92a service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:06.660094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5de7d-fd80-477a-8cd8-49c1bdcfc92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:06.670929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5de7d-fd80-477a-8cd8-49c1bdcfc92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:06.672499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5de7d-fd80-477a-8cd8-49c1bdcfc92a service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:06.683280 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 912/1828] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:07.311516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5822a8-2923-4217-99e7-101fbb3aa05b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:07.313684 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0d5822a8-2923-4217-99e7-101fbb3aa05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:07.327220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5822a8-2923-4217-99e7-101fbb3aa05b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:07.334280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:07.335000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:07.335246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:07.335572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] PATH_INFO: `/v3/projects/2c348cb083e442eea91ac08ed659d9af` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:07.336791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c348cb083e442eea91ac08ed659d9af)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:07.338766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:07.621863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c348cb083e442eea91ac08ed659d9af', 'request_id': 'req-a7381596-b838-42f6-9d3d-d0f21480e1a9'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:07.628535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c348cb083e442eea91ac08ed659d9af', 'request_id': 'req-a7381596-b838-42f6-9d3d-d0f21480e1a9'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:07.919656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202169ec-245c-4b69-933c-1e1005959338 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:07.920104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202169ec-245c-4b69-933c-1e1005959338 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:07.920206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202169ec-245c-4b69-933c-1e1005959338 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:07.923240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 913/1829] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:29:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:29:07.931745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148d6a4-e03a-4075-a319-ba9dfd1b9bbb None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:07.932344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148d6a4-e03a-4075-a319-ba9dfd1b9bbb None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:07.932733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148d6a4-e03a-4075-a319-ba9dfd1b9bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:07.960383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c348cb083e442eea91ac08ed659d9af', 'request_id': 'req-a7381596-b838-42f6-9d3d-d0f21480e1a9'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:07.962412 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c148d6a4-e03a-4075-a319-ba9dfd1b9bbb None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:07.963641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c148d6a4-e03a-4075-a319-ba9dfd1b9bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:07.984093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] The token cache is being invalidate because project 2c348cb083e442eea91ac08ed659d9af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:07.985568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:07.992057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:07.992057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 917/1830] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:07 2022] DELETE /identity/v3/projects/2c348cb083e442eea91ac08ed659d9af => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:07.993275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:07.995199 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:08.056036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 914/1831] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:29:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:08.078570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148d6a4-e03a-4075-a319-ba9dfd1b9bbb None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:08.088041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c148d6a4-e03a-4075-a319-ba9dfd1b9bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:08.110037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381596-b838-42f6-9d3d-d0f21480e1a9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:08.111038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148d6a4-e03a-4075-a319-ba9dfd1b9bbb None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:08.117129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e604a-5887-4604-9933-bb615d065df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:08.117808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e604a-5887-4604-9933-bb615d065df2 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:08.118091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e604a-5887-4604-9933-bb615d065df2 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:08.118366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e604a-5887-4604-9933-bb615d065df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:08.118761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:08.120001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:08.120435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:08.121039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] PATH_INFO: `/v3/users/5df951dbe842405698afac51c08cd14e` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:08.123712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df951dbe842405698afac51c08cd14e)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:08.125370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:08.128430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e604a-5887-4604-9933-bb615d065df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:08.130329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e604a-5887-4604-9933-bb615d065df2 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:08.158638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 915/1832] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:08.161775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e604a-5887-4604-9933-bb615d065df2 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:08.162530 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-405e604a-5887-4604-9933-bb615d065df2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:08.177380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e604a-5887-4604-9933-bb615d065df2 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:08.182254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:08.182993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:08.183369 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:08.183741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] PATH_INFO: `/v3/users/245596bb3cb44646b3f06083e7e2a187` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:08.185045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=245596bb3cb44646b3f06083e7e2a187)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:08.187085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:08.608381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df951dbe842405698afac51c08cd14e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:08.609042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df951dbe842405698afac51c08cd14e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:08.609654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df951dbe842405698afac51c08cd14e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:08.649456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245596bb3cb44646b3f06083e7e2a187'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:08.865880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df951dbe842405698afac51c08cd14e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:08.878774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df951dbe842405698afac51c08cd14e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:08.891281 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 918/1833] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:07 2022] DELETE /identity/v3/users/5df951dbe842405698afac51c08cd14e => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:08.892124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:08.893507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:08.958305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1085ccb-b117-41e8-baa4-41ede984e1f3 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:08.963210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:08.963877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:08.964208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:08.964488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] PATH_INFO: `/v3/users/7b853cb6282049d1b526e62412549c19` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:08.965705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b853cb6282049d1b526e62412549c19)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:08.967645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:08.988056 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245596bb3cb44646b3f06083e7e2a187'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:08.988056 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245596bb3cb44646b3f06083e7e2a187'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:08.999935 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245596bb3cb44646b3f06083e7e2a187'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:09.000636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d66506ac-5a2f-41f5-8621-86464cc199b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245596bb3cb44646b3f06083e7e2a187'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:09.013114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 916/1834] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:08 2022] DELETE /identity/v3/users/245596bb3cb44646b3f06083e7e2a187 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:09.017281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655ee4a-fcfb-4bd5-beef-42dd521bd258 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:09.017565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655ee4a-fcfb-4bd5-beef-42dd521bd258 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:09.017946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655ee4a-fcfb-4bd5-beef-42dd521bd258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:09.036796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4655ee4a-fcfb-4bd5-beef-42dd521bd258 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:09.038061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4655ee4a-fcfb-4bd5-beef-42dd521bd258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:09.095683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 917/1835] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:09.106141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655ee4a-fcfb-4bd5-beef-42dd521bd258 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:09.107496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4655ee4a-fcfb-4bd5-beef-42dd521bd258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:09.164294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655ee4a-fcfb-4bd5-beef-42dd521bd258 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:09.168175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f0d11-56de-4200-b6d0-061f14623897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:09.168824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f0d11-56de-4200-b6d0-061f14623897 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:09.169114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f0d11-56de-4200-b6d0-061f14623897 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:09.169391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f0d11-56de-4200-b6d0-061f14623897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:09.179277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f0d11-56de-4200-b6d0-061f14623897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:09.180873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f0d11-56de-4200-b6d0-061f14623897 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:09.191301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 918/1836] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:09.234782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:09.309517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b853cb6282049d1b526e62412549c19'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:09.310336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b853cb6282049d1b526e62412549c19'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:09.311332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b853cb6282049d1b526e62412549c19'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:09.442113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b853cb6282049d1b526e62412549c19'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:09.454875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b853cb6282049d1b526e62412549c19'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:09.468431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 919/1837] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:08 2022] DELETE /identity/v3/users/7b853cb6282049d1b526e62412549c19 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:09.472691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cee7f-27bf-47f9-a255-f24e9756d181 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:09.473235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cee7f-27bf-47f9-a255-f24e9756d181 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:09.473235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cee7f-27bf-47f9-a255-f24e9756d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:09.492726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e15cee7f-27bf-47f9-a255-f24e9756d181 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:09.493972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e15cee7f-27bf-47f9-a255-f24e9756d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:09.519577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:09.522961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:09.610267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 919/1838] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:09.617559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cee7f-27bf-47f9-a255-f24e9756d181 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:09.622832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e15cee7f-27bf-47f9-a255-f24e9756d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:09.643929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855268a-2b75-450c-a3bd-0bc1d39f5dd8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:09.658140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:09.658140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:09.658140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:09.658140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] PATH_INFO: `/v3/projects/5a44d3ade5ec44f4a41af7e1605fee7b` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:09.658562 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a44d3ade5ec44f4a41af7e1605fee7b)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:09.659940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:09.705487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cee7f-27bf-47f9-a255-f24e9756d181 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:09.712816 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53970ea-21a8-4fb9-a593-b4c5c3d83be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:09.713547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53970ea-21a8-4fb9-a593-b4c5c3d83be7 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:09.713938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53970ea-21a8-4fb9-a593-b4c5c3d83be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:09.714285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53970ea-21a8-4fb9-a593-b4c5c3d83be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:09.727773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53970ea-21a8-4fb9-a593-b4c5c3d83be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:09.729243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53970ea-21a8-4fb9-a593-b4c5c3d83be7 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:09.748152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 920/1839] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:09.873017 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53970ea-21a8-4fb9-a593-b4c5c3d83be7 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:09.874634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f53970ea-21a8-4fb9-a593-b4c5c3d83be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:09.890799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53970ea-21a8-4fb9-a593-b4c5c3d83be7 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:09.893263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a44d3ade5ec44f4a41af7e1605fee7b', 'request_id': 'req-a131c64b-6d26-4572-aed3-0d62aeddc028'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:09.903655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a44d3ade5ec44f4a41af7e1605fee7b', 'request_id': 'req-a131c64b-6d26-4572-aed3-0d62aeddc028'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:10.013352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:10.013948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:10.014237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:10.014516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] PATH_INFO: `/v3/projects/1a137a983c134b06893131ef67a9087a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:10.016295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a137a983c134b06893131ef67a9087a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:10.018278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:10.029377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a44d3ade5ec44f4a41af7e1605fee7b', 'request_id': 'req-a131c64b-6d26-4572-aed3-0d62aeddc028'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:10.041760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] The token cache is being invalidate because project 5a44d3ade5ec44f4a41af7e1605fee7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:10.042184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:10.043276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:10.048019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 920/1840] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:09 2022] DELETE /identity/v3/projects/5a44d3ade5ec44f4a41af7e1605fee7b => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:10.048834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:10.050289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:10.118771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131c64b-6d26-4572-aed3-0d62aeddc028 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:10.123689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3d2cc-c028-4616-8f31-057b14795e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:10.124303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d2cc-c028-4616-8f31-057b14795e31 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:10.124578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d2cc-c028-4616-8f31-057b14795e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:10.124853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d2cc-c028-4616-8f31-057b14795e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:10.126740 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4bc3d2cc-c028-4616-8f31-057b14795e31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:10.196177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3d2cc-c028-4616-8f31-057b14795e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:10.204677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3d2cc-c028-4616-8f31-057b14795e31 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:10.209005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 921/1841] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:10.210140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbe4ca-cff2-49c0-9922-85c583566ff8 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:10.210671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbe4ca-cff2-49c0-9922-85c583566ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:10.210671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbe4ca-cff2-49c0-9922-85c583566ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:10.234515 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1adbe4ca-cff2-49c0-9922-85c583566ff8 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:10.236279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1adbe4ca-cff2-49c0-9922-85c583566ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:10.249495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a137a983c134b06893131ef67a9087a', 'request_id': 'req-d9c1cff1-d2a2-4389-9c35-126b0097b356'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:10.258363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a137a983c134b06893131ef67a9087a', 'request_id': 'req-d9c1cff1-d2a2-4389-9c35-126b0097b356'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:10.349791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 922/1842] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:10.359275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad745bb-efef-4844-9940-f14948ffb964 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:10.361718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad745bb-efef-4844-9940-f14948ffb964 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:10.361718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad745bb-efef-4844-9940-f14948ffb964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:10.366457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a137a983c134b06893131ef67a9087a', 'request_id': 'req-d9c1cff1-d2a2-4389-9c35-126b0097b356'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:10.381208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] The token cache is being invalidate because project 1a137a983c134b06893131ef67a9087a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:10.381432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:10.382950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:10.386079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 921/1843] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:09 2022] DELETE /identity/v3/projects/1a137a983c134b06893131ef67a9087a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:10.390398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:10.394052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:10.400926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9ad745bb-efef-4844-9940-f14948ffb964 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:10.402273 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9ad745bb-efef-4844-9940-f14948ffb964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:10.410033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1cff1-d2a2-4389-9c35-126b0097b356 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:10.416407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:10.417135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:10.417496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:10.417808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] PATH_INFO: `/v3/users/a4f2e1bebb294ed2a38f7168eea8bf8e` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:10.419024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f2e1bebb294ed2a38f7168eea8bf8e)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:10.421691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:10.423851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 923/1844] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:10.424770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad745bb-efef-4844-9940-f14948ffb964 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:10.434858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad745bb-efef-4844-9940-f14948ffb964 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:10.439713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9336-a33d-403e-a7ee-826811b9567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:10.440457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9336-a33d-403e-a7ee-826811b9567b admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:10.440741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9336-a33d-403e-a7ee-826811b9567b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:10.441111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9336-a33d-403e-a7ee-826811b9567b admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:10.441822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f9336-a33d-403e-a7ee-826811b9567b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:10.442173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f9336-a33d-403e-a7ee-826811b9567b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:10.444905 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f9336-a33d-403e-a7ee-826811b9567b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:10.457445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 924/1845] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:10.461763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9336-a33d-403e-a7ee-826811b9567b admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:10.471587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9336-a33d-403e-a7ee-826811b9567b admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:10.476510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6058b-32f7-4699-90d7-34b78aa36532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:10.477119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6058b-32f7-4699-90d7-34b78aa36532 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:10.477397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6058b-32f7-4699-90d7-34b78aa36532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:10.477696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6058b-32f7-4699-90d7-34b78aa36532 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:10.478361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6058b-32f7-4699-90d7-34b78aa36532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:10.484634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6058b-32f7-4699-90d7-34b78aa36532 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:10.684861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 925/1846] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:10 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:10.684861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6058b-32f7-4699-90d7-34b78aa36532 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:10.686491 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3ad6058b-32f7-4699-90d7-34b78aa36532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:10.755538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6058b-32f7-4699-90d7-34b78aa36532 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:10.760973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:10.761919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:10.762201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:10.762474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] PATH_INFO: `/v3/projects/a2c48a37353747c0bc1ccd5019c1e8a6` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:10.763771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c48a37353747c0bc1ccd5019c1e8a6)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:10.765756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:10.889018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f2e1bebb294ed2a38f7168eea8bf8e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:11.482520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c48a37353747c0bc1ccd5019c1e8a6', 'request_id': 'req-f7426b35-da80-48bc-9a0a-6a1433eb206c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:11.492560 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f2e1bebb294ed2a38f7168eea8bf8e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:11.533452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f2e1bebb294ed2a38f7168eea8bf8e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:11.534088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c48a37353747c0bc1ccd5019c1e8a6', 'request_id': 'req-f7426b35-da80-48bc-9a0a-6a1433eb206c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:11.534862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f2e1bebb294ed2a38f7168eea8bf8e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:11.534862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f2e1bebb294ed2a38f7168eea8bf8e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:11.534862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 922/1847] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:10 2022] DELETE /identity/v3/users/a4f2e1bebb294ed2a38f7168eea8bf8e => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:11.535803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:11.538519 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:11.624243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be802fc-4634-4bfa-a1e8-5981d913be3b admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:11.629089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd94ec-57cd-4a72-aff2-5e32825ab18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:11.630510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd94ec-57cd-4a72-aff2-5e32825ab18a admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:11.631118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd94ec-57cd-4a72-aff2-5e32825ab18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:11.631550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd94ec-57cd-4a72-aff2-5e32825ab18a admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:11.632357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd94ec-57cd-4a72-aff2-5e32825ab18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:11.635744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd94ec-57cd-4a72-aff2-5e32825ab18a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:11.710515 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c48a37353747c0bc1ccd5019c1e8a6', 'request_id': 'req-f7426b35-da80-48bc-9a0a-6a1433eb206c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:11.731967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] The token cache is being invalidate because project a2c48a37353747c0bc1ccd5019c1e8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:11.732272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:11.733940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:11.742927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 926/1848] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:10 2022] DELETE /identity/v3/projects/a2c48a37353747c0bc1ccd5019c1e8a6 => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:11.747931 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:11.755609 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 923/1849] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:11 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:11.755751 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:11.759479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd94ec-57cd-4a72-aff2-5e32825ab18a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:11.761407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-fccd94ec-57cd-4a72-aff2-5e32825ab18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:11.787827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd94ec-57cd-4a72-aff2-5e32825ab18a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:11.800858 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa65bca-23e3-4831-b297-19c2dafcbb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:11.804233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa65bca-23e3-4831-b297-19c2dafcbb86 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:11.806039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa65bca-23e3-4831-b297-19c2dafcbb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:11.809106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa65bca-23e3-4831-b297-19c2dafcbb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:11.810046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa65bca-23e3-4831-b297-19c2dafcbb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:11.813009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa65bca-23e3-4831-b297-19c2dafcbb86 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:11.840909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 924/1850] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:11.844550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa65bca-23e3-4831-b297-19c2dafcbb86 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:11.855053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426b35-da80-48bc-9a0a-6a1433eb206c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:11.861239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa65bca-23e3-4831-b297-19c2dafcbb86 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:11.863213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:11.872004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:11.872004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:11.872004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] PATH_INFO: `/v3/users/c342de73d5414d1aa65110da272c7b9e` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:11.872004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c342de73d5414d1aa65110da272c7b9e)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:11.872362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249415ca-d7d5-4110-8c4a-aa60617460c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:11.872362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249415ca-d7d5-4110-8c4a-aa60617460c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:11.872362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249415ca-d7d5-4110-8c4a-aa60617460c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:11.872362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249415ca-d7d5-4110-8c4a-aa60617460c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:11.872645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:11.872720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249415ca-d7d5-4110-8c4a-aa60617460c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:11.873194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249415ca-d7d5-4110-8c4a-aa60617460c7 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:11.892677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 925/1851] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:11.893868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249415ca-d7d5-4110-8c4a-aa60617460c7 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:11.907843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249415ca-d7d5-4110-8c4a-aa60617460c7 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:11.919051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef8e7-8c72-4636-9324-07be693eb08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:11.919051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef8e7-8c72-4636-9324-07be693eb08f admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:11.919051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef8e7-8c72-4636-9324-07be693eb08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:11.919051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef8e7-8c72-4636-9324-07be693eb08f admin admin] PATH_INFO: `/v3/projects/ebc687adc6f54c6495888ebbfa548aab/users/91c973a10f2041c0a012aa38b591a743/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:11.932826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef8e7-8c72-4636-9324-07be693eb08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc687adc6f54c6495888ebbfa548aab, user_id=91c973a10f2041c0a012aa38b591a743, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:11.935634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef8e7-8c72-4636-9324-07be693eb08f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:12.169458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 926/1852] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:11 2022] PUT /identity/v3/projects/ebc687adc6f54c6495888ebbfa548aab/users/91c973a10f2041c0a012aa38b591a743/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:12.180444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a48ae-7477-41dd-b559-fa5c958a0747 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:12.180792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a48ae-7477-41dd-b559-fa5c958a0747 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:12.181008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a48ae-7477-41dd-b559-fa5c958a0747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:12.222961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c29a48ae-7477-41dd-b559-fa5c958a0747 None None] MFA Rules not processed for user `91c973a10f2041c0a012aa38b591a743`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:12.224891 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c29a48ae-7477-41dd-b559-fa5c958a0747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:12.294312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c342de73d5414d1aa65110da272c7b9e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:12.299645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c342de73d5414d1aa65110da272c7b9e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:12.300467 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c342de73d5414d1aa65110da272c7b9e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:12.357226 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 927/1853] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:12.357557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a48ae-7477-41dd-b559-fa5c958a0747 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:12.359686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c29a48ae-7477-41dd-b559-fa5c958a0747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:12.412293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c342de73d5414d1aa65110da272c7b9e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:12.438566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c342de73d5414d1aa65110da272c7b9e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:12.476826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 927/1854] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:11 2022] DELETE /identity/v3/users/c342de73d5414d1aa65110da272c7b9e => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:12.524582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a48ae-7477-41dd-b559-fa5c958a0747 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:12.606793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cde6c4-c797-404b-b0e7-995cde281dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:12.607321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cde6c4-c797-404b-b0e7-995cde281dad admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:12.607608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cde6c4-c797-404b-b0e7-995cde281dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:12.607928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cde6c4-c797-404b-b0e7-995cde281dad admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:12.608631 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cde6c4-c797-404b-b0e7-995cde281dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:12.620465 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cde6c4-c797-404b-b0e7-995cde281dad admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:12.885115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 928/1855] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:12 2022] POST /identity/v3/projects => generated 379 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:12.889115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:12.900046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29abe3-bf55-4c50-b846-d492ead2d47f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:12.965119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001a9cd-dd46-45d8-8b06-bc1a6795af98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:12.965763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001a9cd-dd46-45d8-8b06-bc1a6795af98 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:12.966046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001a9cd-dd46-45d8-8b06-bc1a6795af98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:12.966319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001a9cd-dd46-45d8-8b06-bc1a6795af98 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:12.966945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001a9cd-dd46-45d8-8b06-bc1a6795af98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:12.968944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001a9cd-dd46-45d8-8b06-bc1a6795af98 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:13.028761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cde6c4-c797-404b-b0e7-995cde281dad admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:13.030879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-68cde6c4-c797-404b-b0e7-995cde281dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:13.043132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cde6c4-c797-404b-b0e7-995cde281dad admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:13.048091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:13.049332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:13.049332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:13.049332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] PATH_INFO: `/v3/projects/63851e972dc64a56bd0e05dfb22a0627` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:13.050670 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63851e972dc64a56bd0e05dfb22a0627)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:13.052449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:13.104590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 928/1856] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:12 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:13.114071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001a9cd-dd46-45d8-8b06-bc1a6795af98 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:13.120537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001a9cd-dd46-45d8-8b06-bc1a6795af98 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:13.125994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf5b28-4aab-462c-a610-94d338190d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:13.126627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf5b28-4aab-462c-a610-94d338190d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:13.126962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf5b28-4aab-462c-a610-94d338190d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:13.127642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf5b28-4aab-462c-a610-94d338190d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:13.128473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf5b28-4aab-462c-a610-94d338190d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:13.130781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf5b28-4aab-462c-a610-94d338190d80 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:13.142938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 929/1857] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:13.147561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf5b28-4aab-462c-a610-94d338190d80 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:13.172252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf5b28-4aab-462c-a610-94d338190d80 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:13.172252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac124eb-07f3-4ef7-a27e-97ee2ee02d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:13.172252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac124eb-07f3-4ef7-a27e-97ee2ee02d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:13.172252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac124eb-07f3-4ef7-a27e-97ee2ee02d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:13.173044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac124eb-07f3-4ef7-a27e-97ee2ee02d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:13.173044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac124eb-07f3-4ef7-a27e-97ee2ee02d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:13.173044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac124eb-07f3-4ef7-a27e-97ee2ee02d88 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:13.180204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 930/1858] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:13.184763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac124eb-07f3-4ef7-a27e-97ee2ee02d88 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:13.196659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac124eb-07f3-4ef7-a27e-97ee2ee02d88 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:13.202237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b19e9-e821-45a6-b94d-2209fc14014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:13.203154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b19e9-e821-45a6-b94d-2209fc14014e admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:13.213168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b19e9-e821-45a6-b94d-2209fc14014e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:13.213168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b19e9-e821-45a6-b94d-2209fc14014e admin admin] PATH_INFO: `/v3/projects/976324cbce414cac8b6c7a0ff2ed42b9/users/9c1629b0fec84f3bb3b613395f6407f3/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:13.224974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b19e9-e821-45a6-b94d-2209fc14014e admin admin] RBAC: Authorizing `identity:create_grant(project_id=976324cbce414cac8b6c7a0ff2ed42b9, user_id=9c1629b0fec84f3bb3b613395f6407f3, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:13.227674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b19e9-e821-45a6-b94d-2209fc14014e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:13.234314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63851e972dc64a56bd0e05dfb22a0627', 'request_id': 'req-7d7d3349-26d6-4109-990b-a90d84a2bb90'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:13.243823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63851e972dc64a56bd0e05dfb22a0627', 'request_id': 'req-7d7d3349-26d6-4109-990b-a90d84a2bb90'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:13.377443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 931/1859] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:13 2022] PUT /identity/v3/projects/976324cbce414cac8b6c7a0ff2ed42b9/users/9c1629b0fec84f3bb3b613395f6407f3/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:13.389542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3b8e3-afac-448a-952d-ddf8cc645c0c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:13.389852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3b8e3-afac-448a-952d-ddf8cc645c0c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:13.390128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3b8e3-afac-448a-952d-ddf8cc645c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:13.421239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-a5c3b8e3-afac-448a-952d-ddf8cc645c0c None None] MFA Rules not processed for user `9c1629b0fec84f3bb3b613395f6407f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:13.422664 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a5c3b8e3-afac-448a-952d-ddf8cc645c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:13.434525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63851e972dc64a56bd0e05dfb22a0627', 'request_id': 'req-7d7d3349-26d6-4109-990b-a90d84a2bb90'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:13.451350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] The token cache is being invalidate because project 63851e972dc64a56bd0e05dfb22a0627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:13.451867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:13.452449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d7d3349-26d6-4109-990b-a90d84a2bb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:13.456497 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 929/1860] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:13 2022] DELETE /identity/v3/projects/63851e972dc64a56bd0e05dfb22a0627 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:13.459080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4468b32-3f10-472b-8d7e-63b679aaec0e None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:13.459547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4468b32-3f10-472b-8d7e-63b679aaec0e None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:13.459983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4468b32-3f10-472b-8d7e-63b679aaec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:13.484122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a4468b32-3f10-472b-8d7e-63b679aaec0e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:13.485378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a4468b32-3f10-472b-8d7e-63b679aaec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:13.515846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 932/1861] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:13.520494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3b8e3-afac-448a-952d-ddf8cc645c0c None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:13.522055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a5c3b8e3-afac-448a-952d-ddf8cc645c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:13.547772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 930/1862] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:13.556276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8472-51aa-424b-a67b-ad2afde0f73a None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:13.556597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8472-51aa-424b-a67b-ad2afde0f73a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:13.556938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8472-51aa-424b-a67b-ad2afde0f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:13.577910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-8b3e8472-51aa-424b-a67b-ad2afde0f73a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:13.579120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8b3e8472-51aa-424b-a67b-ad2afde0f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:13.587710 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 931/1863] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:13.589728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3b8e3-afac-448a-952d-ddf8cc645c0c None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:13.592035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8472-51aa-424b-a67b-ad2afde0f73a None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:13.604378 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707baa9-82ac-4b1d-ae16-7ffb583766df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:13.605077 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707baa9-82ac-4b1d-ae16-7ffb583766df admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:13.605357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8472-51aa-424b-a67b-ad2afde0f73a None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:13.605464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707baa9-82ac-4b1d-ae16-7ffb583766df admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:13.605719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707baa9-82ac-4b1d-ae16-7ffb583766df admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:13.606696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707baa9-82ac-4b1d-ae16-7ffb583766df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:13.608884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707baa9-82ac-4b1d-ae16-7ffb583766df admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:13.617216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b98a8-74a5-45db-b121-21ce7cc1fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:13.619287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b98a8-74a5-45db-b121-21ce7cc1fc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:13.619513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b98a8-74a5-45db-b121-21ce7cc1fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:13.619961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b98a8-74a5-45db-b121-21ce7cc1fc93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:13.621430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b98a8-74a5-45db-b121-21ce7cc1fc93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:13.621858 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b98a8-74a5-45db-b121-21ce7cc1fc93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:13.624228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b98a8-74a5-45db-b121-21ce7cc1fc93 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:13.640530 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 932/1864] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:29:13.641881 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b98a8-74a5-45db-b121-21ce7cc1fc93 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:13.643738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a19b98a8-74a5-45db-b121-21ce7cc1fc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:13.656622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b98a8-74a5-45db-b121-21ce7cc1fc93 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:13.661934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:13.662570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:13.662851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:13.663131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] PATH_INFO: `/v3/projects/5c754d1c15b1450db2f13ef8880166d0` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:13.664280 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c754d1c15b1450db2f13ef8880166d0)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:13.666245 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:13.860489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 933/1865] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:13 2022] POST /identity/v3/projects => generated 379 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:13.861431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707baa9-82ac-4b1d-ae16-7ffb583766df admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:13.902044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c754d1c15b1450db2f13ef8880166d0', 'request_id': 'req-edf493f2-aeb1-49f5-b52b-928dddc67757'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:13.914623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c754d1c15b1450db2f13ef8880166d0', 'request_id': 'req-edf493f2-aeb1-49f5-b52b-928dddc67757'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:13.978173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707baa9-82ac-4b1d-ae16-7ffb583766df admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.017162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c754d1c15b1450db2f13ef8880166d0', 'request_id': 'req-edf493f2-aeb1-49f5-b52b-928dddc67757'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:14.034602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] The token cache is being invalidate because project 5c754d1c15b1450db2f13ef8880166d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:14.034602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:14.035341 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:14.037810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 933/1866] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:13 2022] DELETE /identity/v3/projects/5c754d1c15b1450db2f13ef8880166d0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:14.041638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:14.047601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:14.057502 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c7936-8132-43cb-b9d2-01a5564421d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.058089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c7936-8132-43cb-b9d2-01a5564421d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.058374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c7936-8132-43cb-b9d2-01a5564421d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.058650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c7936-8132-43cb-b9d2-01a5564421d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.059357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c7936-8132-43cb-b9d2-01a5564421d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.061281 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c7936-8132-43cb-b9d2-01a5564421d7 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.138175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf493f2-aeb1-49f5-b52b-928dddc67757 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.143236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12639c4-6f14-4bf0-9ad9-5d6d8752dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.143897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12639c4-6f14-4bf0-9ad9-5d6d8752dac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.144178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12639c4-6f14-4bf0-9ad9-5d6d8752dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.144449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12639c4-6f14-4bf0-9ad9-5d6d8752dac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.145084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12639c4-6f14-4bf0-9ad9-5d6d8752dac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.147544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12639c4-6f14-4bf0-9ad9-5d6d8752dac1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.226624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 934/1867] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:13 2022] POST /identity/v3/projects => generated 363 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:14.228874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f7a1c-42ba-4d42-916d-987f18d6fc9f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.229166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f7a1c-42ba-4d42-916d-987f18d6fc9f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.229438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f7a1c-42ba-4d42-916d-987f18d6fc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.269188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-867f7a1c-42ba-4d42-916d-987f18d6fc9f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:14.271241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-867f7a1c-42ba-4d42-916d-987f18d6fc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:14.316043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 934/1868] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:14 2022] POST /identity/v3/users => generated 296 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:14.317234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12639c4-6f14-4bf0-9ad9-5d6d8752dac1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:14.319757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a12639c4-6f14-4bf0-9ad9-5d6d8752dac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:14.336901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12639c4-6f14-4bf0-9ad9-5d6d8752dac1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.354188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 935/1869] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:14.358628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f7a1c-42ba-4d42-916d-987f18d6fc9f None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:14.371678 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f7a1c-42ba-4d42-916d-987f18d6fc9f None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.376747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23444955-4fd8-4f6b-afb6-3e229cf009d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.377379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23444955-4fd8-4f6b-afb6-3e229cf009d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.377655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23444955-4fd8-4f6b-afb6-3e229cf009d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.378010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23444955-4fd8-4f6b-afb6-3e229cf009d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.378674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23444955-4fd8-4f6b-afb6-3e229cf009d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.381586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23444955-4fd8-4f6b-afb6-3e229cf009d0 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.396428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 936/1870] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:14.396428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea7a5-8254-4405-8a3e-238df6d73f54 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.396428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea7a5-8254-4405-8a3e-238df6d73f54 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.396428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea7a5-8254-4405-8a3e-238df6d73f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.419849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-bcfea7a5-8254-4405-8a3e-238df6d73f54 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:14.420743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-bcfea7a5-8254-4405-8a3e-238df6d73f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:14.430957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 937/1871] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:14.434572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea7a5-8254-4405-8a3e-238df6d73f54 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:14.451298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea7a5-8254-4405-8a3e-238df6d73f54 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.459085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c72e6-612e-42b4-8ffc-9f00a16518eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.459719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c72e6-612e-42b4-8ffc-9f00a16518eb admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.460012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c72e6-612e-42b4-8ffc-9f00a16518eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.460291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c72e6-612e-42b4-8ffc-9f00a16518eb admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.460945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c72e6-612e-42b4-8ffc-9f00a16518eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.462993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c72e6-612e-42b4-8ffc-9f00a16518eb admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.471863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcaea75-97a8-41a1-9f5d-f627804d1b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.471863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaea75-97a8-41a1-9f5d-f627804d1b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.471863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaea75-97a8-41a1-9f5d-f627804d1b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.471863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaea75-97a8-41a1-9f5d-f627804d1b82 admin admin] PATH_INFO: `/v3/projects/33ca04df613448d9b458132181970eef/users/b226b17eecd946989e4d8c4542ad5229/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.490390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcaea75-97a8-41a1-9f5d-f627804d1b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ca04df613448d9b458132181970eef, user_id=b226b17eecd946989e4d8c4542ad5229, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.493172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcaea75-97a8-41a1-9f5d-f627804d1b82 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.692968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 938/1872] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:14 2022] PUT /identity/v3/projects/33ca04df613448d9b458132181970eef/users/b226b17eecd946989e4d8c4542ad5229/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:14.694104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcaea75-97a8-41a1-9f5d-f627804d1b82 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:14.695024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 935/1873] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:14 2022] POST /identity/v3/users => generated 282 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:14.696815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c72e6-612e-42b4-8ffc-9f00a16518eb admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:14.711410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c72e6-612e-42b4-8ffc-9f00a16518eb admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.766940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcaea75-97a8-41a1-9f5d-f627804d1b82 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.771851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d249af0-20f5-4ef3-a522-ef2eaae93960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.772357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d249af0-20f5-4ef3-a522-ef2eaae93960 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.772696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d249af0-20f5-4ef3-a522-ef2eaae93960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.772906 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d249af0-20f5-4ef3-a522-ef2eaae93960 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.774012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d249af0-20f5-4ef3-a522-ef2eaae93960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:14.774012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d249af0-20f5-4ef3-a522-ef2eaae93960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.776539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d249af0-20f5-4ef3-a522-ef2eaae93960 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.779396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d028d13-eda8-41e0-b69d-820b94151488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.780036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d028d13-eda8-41e0-b69d-820b94151488 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.786946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d028d13-eda8-41e0-b69d-820b94151488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.786946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d028d13-eda8-41e0-b69d-820b94151488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.786946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d028d13-eda8-41e0-b69d-820b94151488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.786946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d028d13-eda8-41e0-b69d-820b94151488 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.789739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 939/1874] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:14.789739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d249af0-20f5-4ef3-a522-ef2eaae93960 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:14.800188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d249af0-20f5-4ef3-a522-ef2eaae93960 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.804535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 936/1875] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:14.805297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d028d13-eda8-41e0-b69d-820b94151488 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:14.805416 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89ca3-1e18-40b1-841e-c1c4d809ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.805988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89ca3-1e18-40b1-841e-c1c4d809ecd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.806266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89ca3-1e18-40b1-841e-c1c4d809ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.806536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89ca3-1e18-40b1-841e-c1c4d809ecd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.807169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf89ca3-1e18-40b1-841e-c1c4d809ecd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.808887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf89ca3-1e18-40b1-841e-c1c4d809ecd7 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.815291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d028d13-eda8-41e0-b69d-820b94151488 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.820366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 940/1876] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:14.821265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89ca3-1e18-40b1-841e-c1c4d809ecd7 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:14.824135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155671-282b-4d95-8cb8-d901e401ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.824754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155671-282b-4d95-8cb8-d901e401ce0d admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.825055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155671-282b-4d95-8cb8-d901e401ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.825646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155671-282b-4d95-8cb8-d901e401ce0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.825979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a155671-282b-4d95-8cb8-d901e401ce0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.827893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a155671-282b-4d95-8cb8-d901e401ce0d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.836066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89ca3-1e18-40b1-841e-c1c4d809ecd7 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.840864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446f071-c56c-4c70-9b07-918d74dda391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.841589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446f071-c56c-4c70-9b07-918d74dda391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.841986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446f071-c56c-4c70-9b07-918d74dda391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.842330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446f071-c56c-4c70-9b07-918d74dda391 admin admin] PATH_INFO: `/v3/projects/33ca04df613448d9b458132181970eef/users/b226b17eecd946989e4d8c4542ad5229/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.844332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446f071-c56c-4c70-9b07-918d74dda391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ca04df613448d9b458132181970eef, user_id=b226b17eecd946989e4d8c4542ad5229, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.847145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446f071-c56c-4c70-9b07-918d74dda391 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.857880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 941/1877] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:14 2022] PUT /identity/v3/projects/33ca04df613448d9b458132181970eef/users/b226b17eecd946989e4d8c4542ad5229/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:14.858918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446f071-c56c-4c70-9b07-918d74dda391 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:14.922017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446f071-c56c-4c70-9b07-918d74dda391 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:14.930010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68777da3-1ca5-4845-9bf3-e55f741e322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:14.930010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68777da3-1ca5-4845-9bf3-e55f741e322d admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.930010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68777da3-1ca5-4845-9bf3-e55f741e322d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.930010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68777da3-1ca5-4845-9bf3-e55f741e322d admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.930548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68777da3-1ca5-4845-9bf3-e55f741e322d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:14.930789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68777da3-1ca5-4845-9bf3-e55f741e322d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:14.941192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 942/1878] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:14.943058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67178ec3-8f2b-4587-a3b2-abd4cc293e8c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:14.943348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67178ec3-8f2b-4587-a3b2-abd4cc293e8c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:14.943626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67178ec3-8f2b-4587-a3b2-abd4cc293e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:14.970999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-67178ec3-8f2b-4587-a3b2-abd4cc293e8c None None] MFA Rules not processed for user `b226b17eecd946989e4d8c4542ad5229`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:14.977355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-67178ec3-8f2b-4587-a3b2-abd4cc293e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:15.038985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 943/1879] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:15.040126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67178ec3-8f2b-4587-a3b2-abd4cc293e8c None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:15.050690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67178ec3-8f2b-4587-a3b2-abd4cc293e8c None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:15.057319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956d910-47ea-407d-a03d-f40a6b2877ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:15.058325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956d910-47ea-407d-a03d-f40a6b2877ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:15.058670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956d910-47ea-407d-a03d-f40a6b2877ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:15.059135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956d910-47ea-407d-a03d-f40a6b2877ff admin admin] PATH_INFO: `/v3/projects/90c0b5e69a64414c9110865650d31d9d/users/b15abe7860f1481eab4df98f656017e6/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:15.076503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956d910-47ea-407d-a03d-f40a6b2877ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c0b5e69a64414c9110865650d31d9d, user_id=b15abe7860f1481eab4df98f656017e6, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:15.079621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956d910-47ea-407d-a03d-f40a6b2877ff admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:15.173934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 937/1880] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:14 2022] POST /identity/v3/projects => generated 383 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:15.173934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155671-282b-4d95-8cb8-d901e401ce0d admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:15.173934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8a155671-282b-4d95-8cb8-d901e401ce0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:15.255439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155671-282b-4d95-8cb8-d901e401ce0d admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:15.261788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782d700-03c7-4177-950a-e48dfa65379f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:15.262797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782d700-03c7-4177-950a-e48dfa65379f service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:15.264272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782d700-03c7-4177-950a-e48dfa65379f service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:15.264806 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782d700-03c7-4177-950a-e48dfa65379f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:15.355923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782d700-03c7-4177-950a-e48dfa65379f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:15.357344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782d700-03c7-4177-950a-e48dfa65379f service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:15.368032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 938/1881] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:15.372908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782d700-03c7-4177-950a-e48dfa65379f service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:15.435636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782d700-03c7-4177-950a-e48dfa65379f service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:15.441003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25041ba9-48d3-4dbf-82f9-8cfff582405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:15.441823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25041ba9-48d3-4dbf-82f9-8cfff582405e admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:15.442282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25041ba9-48d3-4dbf-82f9-8cfff582405e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:15.442595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25041ba9-48d3-4dbf-82f9-8cfff582405e admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:15.443329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25041ba9-48d3-4dbf-82f9-8cfff582405e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:15.446099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25041ba9-48d3-4dbf-82f9-8cfff582405e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:15.514138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 944/1882] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:15 2022] PUT /identity/v3/projects/90c0b5e69a64414c9110865650d31d9d/users/b15abe7860f1481eab4df98f656017e6/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:15.525099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42b2d2-9257-4c38-8f17-1556867448a7 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:15.525418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42b2d2-9257-4c38-8f17-1556867448a7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:15.525687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42b2d2-9257-4c38-8f17-1556867448a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:15.557834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ec42b2d2-9257-4c38-8f17-1556867448a7 None None] MFA Rules not processed for user `b15abe7860f1481eab4df98f656017e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:15.562664 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ec42b2d2-9257-4c38-8f17-1556867448a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:15.678258 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 939/1883] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:15 2022] POST /identity/v3/users => generated 292 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:15.685448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25041ba9-48d3-4dbf-82f9-8cfff582405e admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:15.707412 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25041ba9-48d3-4dbf-82f9-8cfff582405e admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:15.713523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 945/1884] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:15.715418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42b2d2-9257-4c38-8f17-1556867448a7 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:15.717266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ec42b2d2-9257-4c38-8f17-1556867448a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:15.781449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7e9ad-3d59-476d-95fb-e62326e01001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:15.782375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7e9ad-3d59-476d-95fb-e62326e01001 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:15.782623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7e9ad-3d59-476d-95fb-e62326e01001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:15.782996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7e9ad-3d59-476d-95fb-e62326e01001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:15.783398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42b2d2-9257-4c38-8f17-1556867448a7 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:15.783853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7e9ad-3d59-476d-95fb-e62326e01001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:15.785561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7e9ad-3d59-476d-95fb-e62326e01001 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:15.789608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344bf2d-576a-4c64-8438-ac09a6b24514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:15.790276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344bf2d-576a-4c64-8438-ac09a6b24514 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:15.790779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344bf2d-576a-4c64-8438-ac09a6b24514 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:15.791100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344bf2d-576a-4c64-8438-ac09a6b24514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:15.793505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a344bf2d-576a-4c64-8438-ac09a6b24514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:15.803600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 940/1885] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:15.803600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7e9ad-3d59-476d-95fb-e62326e01001 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:15.813050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7e9ad-3d59-476d-95fb-e62326e01001 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:15.819573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73692ff-41c0-4ff1-beff-45f519f87dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:15.820449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73692ff-41c0-4ff1-beff-45f519f87dcb admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:15.820897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73692ff-41c0-4ff1-beff-45f519f87dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:15.821331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73692ff-41c0-4ff1-beff-45f519f87dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:15.822193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73692ff-41c0-4ff1-beff-45f519f87dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:15.824969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73692ff-41c0-4ff1-beff-45f519f87dcb admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:15.892747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344bf2d-576a-4c64-8438-ac09a6b24514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:15.894469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344bf2d-576a-4c64-8438-ac09a6b24514 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:15.904424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 946/1886] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:15.905264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344bf2d-576a-4c64-8438-ac09a6b24514 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:15.915446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344bf2d-576a-4c64-8438-ac09a6b24514 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:15.920274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088712-7b5a-4f3c-8303-b90de857bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:15.920891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088712-7b5a-4f3c-8303-b90de857bf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:15.921212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088712-7b5a-4f3c-8303-b90de857bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:15.921523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088712-7b5a-4f3c-8303-b90de857bf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:15.922239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25088712-7b5a-4f3c-8303-b90de857bf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:15.923999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25088712-7b5a-4f3c-8303-b90de857bf1c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:15.935151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 947/1887] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:15.939174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088712-7b5a-4f3c-8303-b90de857bf1c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:15.952248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088712-7b5a-4f3c-8303-b90de857bf1c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:15.956999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a038aa-fc8e-48a2-a082-a07c86380549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:15.958044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a038aa-fc8e-48a2-a082-a07c86380549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:15.959089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a038aa-fc8e-48a2-a082-a07c86380549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:15.959436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a038aa-fc8e-48a2-a082-a07c86380549 admin admin] PATH_INFO: `/v3/projects/36baf29347e14306bcf7e9bf1697e975/users/4fb7e24dd9e54ed2a9156a0f7732579c/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:15.975146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a038aa-fc8e-48a2-a082-a07c86380549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36baf29347e14306bcf7e9bf1697e975, user_id=4fb7e24dd9e54ed2a9156a0f7732579c, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:15.977930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a038aa-fc8e-48a2-a082-a07c86380549 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:16.322448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 941/1888] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:15 2022] POST /identity/v3/projects => generated 363 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:16.326741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73692ff-41c0-4ff1-beff-45f519f87dcb admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:16.388110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73692ff-41c0-4ff1-beff-45f519f87dcb admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:16.392931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be5f7e-d74b-4afe-97bf-9e17899734d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:16.393477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be5f7e-d74b-4afe-97bf-9e17899734d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:16.393690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be5f7e-d74b-4afe-97bf-9e17899734d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:16.394045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be5f7e-d74b-4afe-97bf-9e17899734d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:16.394681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be5f7e-d74b-4afe-97bf-9e17899734d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:16.425519 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be5f7e-d74b-4afe-97bf-9e17899734d5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:16.426223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 948/1889] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:15 2022] PUT /identity/v3/projects/36baf29347e14306bcf7e9bf1697e975/users/4fb7e24dd9e54ed2a9156a0f7732579c/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:16.436922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8cf89-cd5f-462d-aeb9-1331ab0f4c8d None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:16.437256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8cf89-cd5f-462d-aeb9-1331ab0f4c8d None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:16.437569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8cf89-cd5f-462d-aeb9-1331ab0f4c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:16.488124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-48e8cf89-cd5f-462d-aeb9-1331ab0f4c8d None None] MFA Rules not processed for user `4fb7e24dd9e54ed2a9156a0f7732579c`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:16.494031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-48e8cf89-cd5f-462d-aeb9-1331ab0f4c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:16.590866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 949/1890] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:16.602675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8cf89-cd5f-462d-aeb9-1331ab0f4c8d None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:16.659653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8cf89-cd5f-462d-aeb9-1331ab0f4c8d None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:16.664345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b12ea-b393-4999-af1b-feecbd304ee1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:16.664998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b12ea-b393-4999-af1b-feecbd304ee1 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:16.682967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b12ea-b393-4999-af1b-feecbd304ee1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:16.682967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b12ea-b393-4999-af1b-feecbd304ee1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:16.682967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b12ea-b393-4999-af1b-feecbd304ee1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:16.682967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b12ea-b393-4999-af1b-feecbd304ee1 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:16.686760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 950/1891] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:16.709267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b12ea-b393-4999-af1b-feecbd304ee1 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:16.742847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:16.784951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b12ea-b393-4999-af1b-feecbd304ee1 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:16.790079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:16.790705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:16.790986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:16.791260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] PATH_INFO: `/v3/users/4fb7e24dd9e54ed2a9156a0f7732579c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:16.792395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb7e24dd9e54ed2a9156a0f7732579c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:16.794352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:16.835426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 942/1892] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:16 2022] POST /identity/v3/users => generated 288 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:16.838533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be5f7e-d74b-4afe-97bf-9e17899734d5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:16.851979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be5f7e-d74b-4afe-97bf-9e17899734d5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:16.857115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d3382-d4da-4c26-a484-dec76640761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:16.857755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d3382-d4da-4c26-a484-dec76640761f admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:16.858035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d3382-d4da-4c26-a484-dec76640761f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:16.858313 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d3382-d4da-4c26-a484-dec76640761f admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:16.858970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d3382-d4da-4c26-a484-dec76640761f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:16.861131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d3382-d4da-4c26-a484-dec76640761f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:16.873781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 943/1893] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:16.878075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d3382-d4da-4c26-a484-dec76640761f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:16.888779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d3382-d4da-4c26-a484-dec76640761f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:16.892846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea332c6-9ae2-40d6-89d6-93d154314214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:16.895753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea332c6-9ae2-40d6-89d6-93d154314214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:16.895753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea332c6-9ae2-40d6-89d6-93d154314214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:16.895753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea332c6-9ae2-40d6-89d6-93d154314214 admin admin] PATH_INFO: `/v3/projects/ae9169873e6342af96e2522f54ff735a/users/5e7db419e7684396b2c7de8360ceaa18/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:16.911994 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea332c6-9ae2-40d6-89d6-93d154314214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9169873e6342af96e2522f54ff735a, user_id=5e7db419e7684396b2c7de8360ceaa18, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:16.914685 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea332c6-9ae2-40d6-89d6-93d154314214 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:17.205139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 944/1894] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:16 2022] PUT /identity/v3/projects/ae9169873e6342af96e2522f54ff735a/users/5e7db419e7684396b2c7de8360ceaa18/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:17.209359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea332c6-9ae2-40d6-89d6-93d154314214 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:17.349167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea332c6-9ae2-40d6-89d6-93d154314214 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:17.349167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39045031-ecc6-4435-8e6d-acb0c4f11e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:17.349167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39045031-ecc6-4435-8e6d-acb0c4f11e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:17.349167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39045031-ecc6-4435-8e6d-acb0c4f11e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:17.349785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39045031-ecc6-4435-8e6d-acb0c4f11e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:17.349785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39045031-ecc6-4435-8e6d-acb0c4f11e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:17.349962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb7e24dd9e54ed2a9156a0f7732579c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:17.349962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb7e24dd9e54ed2a9156a0f7732579c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:17.350122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39045031-ecc6-4435-8e6d-acb0c4f11e24 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:17.350208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb7e24dd9e54ed2a9156a0f7732579c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:17.357139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 945/1895] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:17.362073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39045031-ecc6-4435-8e6d-acb0c4f11e24 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:17.366234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-39045031-ecc6-4435-8e6d-acb0c4f11e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:17.399559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39045031-ecc6-4435-8e6d-acb0c4f11e24 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:17.399559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9e6ec-1ff3-4bc9-90af-bd8988f98659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:17.399559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9e6ec-1ff3-4bc9-90af-bd8988f98659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:17.399559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9e6ec-1ff3-4bc9-90af-bd8988f98659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:17.399919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9e6ec-1ff3-4bc9-90af-bd8988f98659 admin admin] PATH_INFO: `/v3/projects/ae9169873e6342af96e2522f54ff735a/users/5e7db419e7684396b2c7de8360ceaa18/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:17.400839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9e6ec-1ff3-4bc9-90af-bd8988f98659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9169873e6342af96e2522f54ff735a, user_id=5e7db419e7684396b2c7de8360ceaa18, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:17.403574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9e6ec-1ff3-4bc9-90af-bd8988f98659 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:17.424984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 946/1896] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:17 2022] PUT /identity/v3/projects/ae9169873e6342af96e2522f54ff735a/users/5e7db419e7684396b2c7de8360ceaa18/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:17.426874 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d5588-68a7-4e6d-a9b1-e17bb21066c7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:17.427676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d5588-68a7-4e6d-a9b1-e17bb21066c7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:17.427952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d5588-68a7-4e6d-a9b1-e17bb21066c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:17.473126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-2e6d5588-68a7-4e6d-a9b1-e17bb21066c7 None None] MFA Rules not processed for user `5e7db419e7684396b2c7de8360ceaa18`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:17.473126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2e6d5588-68a7-4e6d-a9b1-e17bb21066c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:17.531992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 947/1897] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:17.543536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d5588-68a7-4e6d-a9b1-e17bb21066c7 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:17.544915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2e6d5588-68a7-4e6d-a9b1-e17bb21066c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:17.555617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb7e24dd9e54ed2a9156a0f7732579c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:17.571119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-c3aa7593-85b6-4766-8634-3d20240e6c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb7e24dd9e54ed2a9156a0f7732579c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:17.584509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 951/1898] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:16 2022] DELETE /identity/v3/users/4fb7e24dd9e54ed2a9156a0f7732579c => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:17.588695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c6051-ddbf-434c-87b4-e6cfeeac80a8 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:17.588983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c6051-ddbf-434c-87b4-e6cfeeac80a8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:17.589267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c6051-ddbf-434c-87b4-e6cfeeac80a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:17.607049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d5588-68a7-4e6d-a9b1-e17bb21066c7 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:17.608698 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-270c6051-ddbf-434c-87b4-e6cfeeac80a8 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:17.609944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-270c6051-ddbf-434c-87b4-e6cfeeac80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:17.655434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b923bf8-a8a0-4ef2-a541-db27b6cf1726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:17.656052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b923bf8-a8a0-4ef2-a541-db27b6cf1726 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:17.656335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b923bf8-a8a0-4ef2-a541-db27b6cf1726 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:17.656612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b923bf8-a8a0-4ef2-a541-db27b6cf1726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:17.669129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 952/1899] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:17.680043 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c6051-ddbf-434c-87b4-e6cfeeac80a8 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:17.682030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-270c6051-ddbf-434c-87b4-e6cfeeac80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:17.729276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b923bf8-a8a0-4ef2-a541-db27b6cf1726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:17.730827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b923bf8-a8a0-4ef2-a541-db27b6cf1726 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:17.741215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 948/1900] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:17.742878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c6051-ddbf-434c-87b4-e6cfeeac80a8 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:17.752456 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872468b-6aa6-4a80-aa0b-e49bae996e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:17.753101 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872468b-6aa6-4a80-aa0b-e49bae996e4e service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:17.753754 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872468b-6aa6-4a80-aa0b-e49bae996e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:17.754154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872468b-6aa6-4a80-aa0b-e49bae996e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:17.766624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872468b-6aa6-4a80-aa0b-e49bae996e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:17.768070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872468b-6aa6-4a80-aa0b-e49bae996e4e service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:17.780432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 953/1901] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:18.079668 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b923bf8-a8a0-4ef2-a541-db27b6cf1726 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:18.081509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6b923bf8-a8a0-4ef2-a541-db27b6cf1726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:18.102208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b923bf8-a8a0-4ef2-a541-db27b6cf1726 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:18.108521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:18.109177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:18.109622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:18.110137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] PATH_INFO: `/v3/users/45ecab6e4bc14f9e8f17c31b6647bdd4` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:18.111317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ecab6e4bc14f9e8f17c31b6647bdd4)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:18.113230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:18.494457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872468b-6aa6-4a80-aa0b-e49bae996e4e service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:18.494457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d872468b-6aa6-4a80-aa0b-e49bae996e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:18.504307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872468b-6aa6-4a80-aa0b-e49bae996e4e service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:18.510143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:18.510839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:18.511214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:18.511427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] PATH_INFO: `/v3/projects/36baf29347e14306bcf7e9bf1697e975` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:18.512642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36baf29347e14306bcf7e9bf1697e975)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:18.515664 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:18.563911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ecab6e4bc14f9e8f17c31b6647bdd4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:18.709695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ecab6e4bc14f9e8f17c31b6647bdd4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:18.710357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ecab6e4bc14f9e8f17c31b6647bdd4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:18.724313 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ecab6e4bc14f9e8f17c31b6647bdd4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:18.725788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-210b99d4-530e-4401-b8f3-9a70750f48bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ecab6e4bc14f9e8f17c31b6647bdd4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:18.734794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36baf29347e14306bcf7e9bf1697e975', 'request_id': 'req-fee3fed6-47ba-477a-a517-571f46b86191'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:18.744410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36baf29347e14306bcf7e9bf1697e975', 'request_id': 'req-fee3fed6-47ba-477a-a517-571f46b86191'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:18.744919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 949/1902] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:18 2022] DELETE /identity/v3/users/45ecab6e4bc14f9e8f17c31b6647bdd4 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:18.751650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538622cd-8f18-4e4f-b0f7-c28a3f1daf75 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:18.752408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538622cd-8f18-4e4f-b0f7-c28a3f1daf75 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:18.752991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538622cd-8f18-4e4f-b0f7-c28a3f1daf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:18.781107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-538622cd-8f18-4e4f-b0f7-c28a3f1daf75 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:18.782505 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-538622cd-8f18-4e4f-b0f7-c28a3f1daf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:18.859522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 950/1903] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:18.866595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538622cd-8f18-4e4f-b0f7-c28a3f1daf75 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:18.868422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-538622cd-8f18-4e4f-b0f7-c28a3f1daf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:18.916868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36baf29347e14306bcf7e9bf1697e975', 'request_id': 'req-fee3fed6-47ba-477a-a517-571f46b86191'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:18.932666 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] The token cache is being invalidate because project 36baf29347e14306bcf7e9bf1697e975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:18.933004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:18.934008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fee3fed6-47ba-477a-a517-571f46b86191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:18.937215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 954/1904] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:18 2022] DELETE /identity/v3/projects/36baf29347e14306bcf7e9bf1697e975 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:18.942007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11dac-b6cc-4432-b23e-5095d13341ea None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:18.942765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11dac-b6cc-4432-b23e-5095d13341ea None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:18.943175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11dac-b6cc-4432-b23e-5095d13341ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:18.967691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538622cd-8f18-4e4f-b0f7-c28a3f1daf75 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:18.975382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-8ad11dac-b6cc-4432-b23e-5095d13341ea None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:18.977356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8ad11dac-b6cc-4432-b23e-5095d13341ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:18.978189 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d37b1b-aa96-4cd1-ac02-d5353e370b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:18.978945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d37b1b-aa96-4cd1-ac02-d5353e370b33 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:18.979406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d37b1b-aa96-4cd1-ac02-d5353e370b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:18.979584 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d37b1b-aa96-4cd1-ac02-d5353e370b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:18.983382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-77d37b1b-aa96-4cd1-ac02-d5353e370b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:19.002725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 955/1905] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:19.005059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d37b1b-aa96-4cd1-ac02-d5353e370b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:19.010718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d37b1b-aa96-4cd1-ac02-d5353e370b33 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:19.017642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c5a9-ef60-4d9f-aa5b-7859a6869835 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.018039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c5a9-ef60-4d9f-aa5b-7859a6869835 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.018399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c5a9-ef60-4d9f-aa5b-7859a6869835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.027254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 951/1906] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:19.054390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c2c5c5a9-ef60-4d9f-aa5b-7859a6869835 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:19.055736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c2c5c5a9-ef60-4d9f-aa5b-7859a6869835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:19.068369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 956/1907] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:19.075910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d37b1b-aa96-4cd1-ac02-d5353e370b33 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:19.091348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d37b1b-aa96-4cd1-ac02-d5353e370b33 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:19.091996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e70ec-dacd-41fc-aa23-74cd0b668b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:19.092843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e70ec-dacd-41fc-aa23-74cd0b668b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.093334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e70ec-dacd-41fc-aa23-74cd0b668b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.093687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e70ec-dacd-41fc-aa23-74cd0b668b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.094424 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e70ec-dacd-41fc-aa23-74cd0b668b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:19.094794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e70ec-dacd-41fc-aa23-74cd0b668b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:19.096444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e70ec-dacd-41fc-aa23-74cd0b668b0b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:19.112012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 952/1908] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:19.117269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5c5a9-ef60-4d9f-aa5b-7859a6869835 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:19.127811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5c5a9-ef60-4d9f-aa5b-7859a6869835 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:19.132454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153ea20-8af0-4db5-a91a-c80d181aa39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:19.133131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153ea20-8af0-4db5-a91a-c80d181aa39f admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.133417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153ea20-8af0-4db5-a91a-c80d181aa39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.133714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153ea20-8af0-4db5-a91a-c80d181aa39f admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.134358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153ea20-8af0-4db5-a91a-c80d181aa39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:19.136239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153ea20-8af0-4db5-a91a-c80d181aa39f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:19.259789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 957/1909] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:19 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:19.264548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e70ec-dacd-41fc-aa23-74cd0b668b0b admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:19.275928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e70ec-dacd-41fc-aa23-74cd0b668b0b admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:19.337205 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862eed7-3a56-49c5-87a3-2cd2c1d77f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:19.337891 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862eed7-3a56-49c5-87a3-2cd2c1d77f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.338175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862eed7-3a56-49c5-87a3-2cd2c1d77f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.338456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862eed7-3a56-49c5-87a3-2cd2c1d77f45 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.339116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862eed7-3a56-49c5-87a3-2cd2c1d77f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:19.341095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862eed7-3a56-49c5-87a3-2cd2c1d77f45 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:19.381417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153ea20-8af0-4db5-a91a-c80d181aa39f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:19.383204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6153ea20-8af0-4db5-a91a-c80d181aa39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:19.397139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153ea20-8af0-4db5-a91a-c80d181aa39f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:19.401771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:19.404347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.404347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.404347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] PATH_INFO: `/v3/users/b15abe7860f1481eab4df98f656017e6` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.404347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15abe7860f1481eab4df98f656017e6)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:19.406551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:19.455905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 953/1910] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:19 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:19.457055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862eed7-3a56-49c5-87a3-2cd2c1d77f45 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:19.468320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862eed7-3a56-49c5-87a3-2cd2c1d77f45 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:19.473219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b475d32-6aa4-437c-a747-ffc7c451b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:19.474594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475d32-6aa4-437c-a747-ffc7c451b21a admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.474881 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475d32-6aa4-437c-a747-ffc7c451b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.475652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475d32-6aa4-437c-a747-ffc7c451b21a admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.475810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b475d32-6aa4-437c-a747-ffc7c451b21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:19.477485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b475d32-6aa4-437c-a747-ffc7c451b21a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:19.489432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 954/1911] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:19.493597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b475d32-6aa4-437c-a747-ffc7c451b21a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:19.503510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b475d32-6aa4-437c-a747-ffc7c451b21a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:19.508282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b503-91de-47bc-a496-ca582b8e5722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:19.508905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b503-91de-47bc-a496-ca582b8e5722 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.509188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b503-91de-47bc-a496-ca582b8e5722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.509637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031b503-91de-47bc-a496-ca582b8e5722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.510501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031b503-91de-47bc-a496-ca582b8e5722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:19.512095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031b503-91de-47bc-a496-ca582b8e5722 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:19.523802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 955/1912] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:19.532398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b503-91de-47bc-a496-ca582b8e5722 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:19.554453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031b503-91de-47bc-a496-ca582b8e5722 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:19.563096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79c91b-ae60-4f55-a4bb-ef73769ef1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:19.563096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c91b-ae60-4f55-a4bb-ef73769ef1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.563096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c91b-ae60-4f55-a4bb-ef73769ef1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.563096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c91b-ae60-4f55-a4bb-ef73769ef1e7 admin admin] PATH_INFO: `/v3/projects/a79fcad5fc99488fb7bd3e1f27d3a96e/users/75773043ef6743859329ae16afe18bc0/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.581261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79c91b-ae60-4f55-a4bb-ef73769ef1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79fcad5fc99488fb7bd3e1f27d3a96e, user_id=75773043ef6743859329ae16afe18bc0, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:19.585365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79c91b-ae60-4f55-a4bb-ef73769ef1e7 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:19.603476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:19.667745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15abe7860f1481eab4df98f656017e6'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:19.668326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15abe7860f1481eab4df98f656017e6'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:19.668935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15abe7860f1481eab4df98f656017e6'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:19.695307 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 956/1913] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:19 2022] PUT /identity/v3/projects/a79fcad5fc99488fb7bd3e1f27d3a96e/users/75773043ef6743859329ae16afe18bc0/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:19.706127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f46e5-76e8-4987-8c2c-b62b64303fe6 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.706415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f46e5-76e8-4987-8c2c-b62b64303fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.706773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f46e5-76e8-4987-8c2c-b62b64303fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.737739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-946f46e5-76e8-4987-8c2c-b62b64303fe6 None None] MFA Rules not processed for user `75773043ef6743859329ae16afe18bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:19.739036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-946f46e5-76e8-4987-8c2c-b62b64303fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:19.814901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15abe7860f1481eab4df98f656017e6'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:19.853829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15abe7860f1481eab4df98f656017e6'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:19.856678 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 957/1914] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:19.872853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 958/1915] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:19 2022] DELETE /identity/v3/users/b15abe7860f1481eab4df98f656017e6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:19.874193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463b494-fdba-48f4-8957-0c98e283c26a None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.874489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463b494-fdba-48f4-8957-0c98e283c26a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.874767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463b494-fdba-48f4-8957-0c98e283c26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.874999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:19.876805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:19.897232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9463b494-fdba-48f4-8957-0c98e283c26a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:19.898658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9463b494-fdba-48f4-8957-0c98e283c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:19.947521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5b1a5-f346-4b36-9312-8ad2ee05204b admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:19.952753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be66a6-c4e1-4a3a-bf41-51e55cea4c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:19.953935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be66a6-c4e1-4a3a-bf41-51e55cea4c84 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:19.955683 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be66a6-c4e1-4a3a-bf41-51e55cea4c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:19.955683 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be66a6-c4e1-4a3a-bf41-51e55cea4c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:19.978102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 958/1916] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:19.987791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463b494-fdba-48f4-8957-0c98e283c26a None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:19.990003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9463b494-fdba-48f4-8957-0c98e283c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:20.030879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be66a6-c4e1-4a3a-bf41-51e55cea4c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:20.032496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be66a6-c4e1-4a3a-bf41-51e55cea4c84 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:20.044719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 959/1917] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:20.065478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463b494-fdba-48f4-8957-0c98e283c26a None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:20.065478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a28806-0533-48aa-a1b7-4ef52a59f076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:20.065478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a28806-0533-48aa-a1b7-4ef52a59f076 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:20.065478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a28806-0533-48aa-a1b7-4ef52a59f076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:20.066957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a28806-0533-48aa-a1b7-4ef52a59f076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:20.077431 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a28806-0533-48aa-a1b7-4ef52a59f076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:20.078931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a28806-0533-48aa-a1b7-4ef52a59f076 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:20.089980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 959/1918] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:20.305564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be66a6-c4e1-4a3a-bf41-51e55cea4c84 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:20.308515 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e5be66a6-c4e1-4a3a-bf41-51e55cea4c84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:20.327858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be66a6-c4e1-4a3a-bf41-51e55cea4c84 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:20.333984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:20.334831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:20.335119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:20.335395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] PATH_INFO: `/v3/projects/956f2b2d41ec4c93ac3ebb77e7382e7c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:20.336582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956f2b2d41ec4c93ac3ebb77e7382e7c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:20.338525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:20.513554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956f2b2d41ec4c93ac3ebb77e7382e7c', 'request_id': 'req-0512235a-87a7-4aa5-b760-175e6062ea79'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:20.520560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956f2b2d41ec4c93ac3ebb77e7382e7c', 'request_id': 'req-0512235a-87a7-4aa5-b760-175e6062ea79'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:20.597196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a28806-0533-48aa-a1b7-4ef52a59f076 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:20.603451 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-17a28806-0533-48aa-a1b7-4ef52a59f076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:20.615468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a28806-0533-48aa-a1b7-4ef52a59f076 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:20.637609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956f2b2d41ec4c93ac3ebb77e7382e7c', 'request_id': 'req-0512235a-87a7-4aa5-b760-175e6062ea79'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:20.656230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] The token cache is being invalidate because project 956f2b2d41ec4c93ac3ebb77e7382e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:20.656717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:20.657452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:20.659433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 960/1919] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:20 2022] DELETE /identity/v3/projects/956f2b2d41ec4c93ac3ebb77e7382e7c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:20.663422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:20.670621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:20.711504 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:20.712465 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:20.712750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:20.713031 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] PATH_INFO: `/v3/projects/90c0b5e69a64414c9110865650d31d9d` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:20.714250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c0b5e69a64414c9110865650d31d9d)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:20.716415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:20.762927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512235a-87a7-4aa5-b760-175e6062ea79 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:20.768154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:20.768918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:20.769231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:20.769535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] PATH_INFO: `/v3/users/d40dceb6c8cc4ccc99e707f5a97824e0` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:20.770847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40dceb6c8cc4ccc99e707f5a97824e0)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:20.773548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:20.877076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c0b5e69a64414c9110865650d31d9d', 'request_id': 'req-926d84a4-35be-4118-ba5a-ebefefba1b31'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:20.888686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c0b5e69a64414c9110865650d31d9d', 'request_id': 'req-926d84a4-35be-4118-ba5a-ebefefba1b31'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.008779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c0b5e69a64414c9110865650d31d9d', 'request_id': 'req-926d84a4-35be-4118-ba5a-ebefefba1b31'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.028460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] The token cache is being invalidate because project 90c0b5e69a64414c9110865650d31d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:21.028897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.029572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.031927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 960/1920] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:20 2022] DELETE /identity/v3/projects/90c0b5e69a64414c9110865650d31d9d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:21.035943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:21.037426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:21.108544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d84a4-35be-4118-ba5a-ebefefba1b31 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:21.113345 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:21.114067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:21.114377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:21.119148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] PATH_INFO: `/v3/users/5e7db419e7684396b2c7de8360ceaa18` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:21.119148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7db419e7684396b2c7de8360ceaa18)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:21.119148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:21.159889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40dceb6c8cc4ccc99e707f5a97824e0'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.160588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40dceb6c8cc4ccc99e707f5a97824e0'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.161721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40dceb6c8cc4ccc99e707f5a97824e0'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.292759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40dceb6c8cc4ccc99e707f5a97824e0'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.307851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:21.311475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40dceb6c8cc4ccc99e707f5a97824e0'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.324095 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 961/1921] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:20 2022] DELETE /identity/v3/users/d40dceb6c8cc4ccc99e707f5a97824e0 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:21.391374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7db419e7684396b2c7de8360ceaa18'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.494095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7db419e7684396b2c7de8360ceaa18'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.494836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7db419e7684396b2c7de8360ceaa18'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.508460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7db419e7684396b2c7de8360ceaa18'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.509252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7db419e7684396b2c7de8360ceaa18'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:21.524229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 961/1922] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:21 2022] DELETE /identity/v3/users/5e7db419e7684396b2c7de8360ceaa18 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:21.924278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:21.925788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:21.983510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:22.041202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104b24-819c-47fe-9303-b68e9380ce7d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:22.097838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:22.098402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.098686 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.099008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] PATH_INFO: `/v3/projects/c295809b5ab246eea834fb3de9c8bf59` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.100195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c295809b5ab246eea834fb3de9c8bf59)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:22.102172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:22.145520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:22.152436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:22.183799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f86fc1-5e8f-4281-9232-8476b96e05ff admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:22.191206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:22.191963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.192251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.193045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] PATH_INFO: `/v3/projects/ae9169873e6342af96e2522f54ff735a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.195012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9169873e6342af96e2522f54ff735a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:22.197025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:22.282389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c295809b5ab246eea834fb3de9c8bf59', 'request_id': 'req-85b8e74d-16f8-4b94-acff-85dfada8c9c3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:22.288849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c295809b5ab246eea834fb3de9c8bf59', 'request_id': 'req-85b8e74d-16f8-4b94-acff-85dfada8c9c3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:22.374129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9169873e6342af96e2522f54ff735a', 'request_id': 'req-12de54e6-927a-4d99-9ffb-8201324dfd83'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:22.381031 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9169873e6342af96e2522f54ff735a', 'request_id': 'req-12de54e6-927a-4d99-9ffb-8201324dfd83'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:22.457698 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c295809b5ab246eea834fb3de9c8bf59', 'request_id': 'req-85b8e74d-16f8-4b94-acff-85dfada8c9c3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:22.469038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] The token cache is being invalidate because project c295809b5ab246eea834fb3de9c8bf59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:22.469330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:22.470006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-85b8e74d-16f8-4b94-acff-85dfada8c9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:22.471528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 962/1923] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:21 2022] DELETE /identity/v3/projects/c295809b5ab246eea834fb3de9c8bf59 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:22.476091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86e49-9827-486d-b469-87d9edb8c3a7 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.476375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86e49-9827-486d-b469-87d9edb8c3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.476651 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86e49-9827-486d-b469-87d9edb8c3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.496058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4ce86e49-9827-486d-b469-87d9edb8c3a7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:22.497247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4ce86e49-9827-486d-b469-87d9edb8c3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:22.554661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 963/1924] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:22.562060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad73e9-601b-40ca-be87-bad4d3b540b7 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.562350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad73e9-601b-40ca-be87-bad4d3b540b7 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.562623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad73e9-601b-40ca-be87-bad4d3b540b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.583852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9169873e6342af96e2522f54ff735a', 'request_id': 'req-12de54e6-927a-4d99-9ffb-8201324dfd83'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:22.584042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-8dad73e9-601b-40ca-be87-bad4d3b540b7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:22.585177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8dad73e9-601b-40ca-be87-bad4d3b540b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:22.593878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 964/1925] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:22.594859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] The token cache is being invalidate because project ae9169873e6342af96e2522f54ff735a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:22.595177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:22.595833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12de54e6-927a-4d99-9ffb-8201324dfd83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:22.597480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 962/1926] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:22 2022] DELETE /identity/v3/projects/ae9169873e6342af96e2522f54ff735a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:22.598060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad73e9-601b-40ca-be87-bad4d3b540b7 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:22.602424 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c790b1-5339-4b07-a5fb-bc286c2262c4 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.602653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c790b1-5339-4b07-a5fb-bc286c2262c4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.602935 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c790b1-5339-4b07-a5fb-bc286c2262c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.607889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad73e9-601b-40ca-be87-bad4d3b540b7 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:22.613003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd26ab-d346-4514-82fd-8bd92b64ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:22.613615 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd26ab-d346-4514-82fd-8bd92b64ef20 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.613931 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd26ab-d346-4514-82fd-8bd92b64ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.614202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd26ab-d346-4514-82fd-8bd92b64ef20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.615470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd26ab-d346-4514-82fd-8bd92b64ef20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:22.615784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd26ab-d346-4514-82fd-8bd92b64ef20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:22.617428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd26ab-d346-4514-82fd-8bd92b64ef20 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:22.623406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-d6c790b1-5339-4b07-a5fb-bc286c2262c4 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:22.624619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d6c790b1-5339-4b07-a5fb-bc286c2262c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:22.629856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 965/1927] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:29:22.634252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd26ab-d346-4514-82fd-8bd92b64ef20 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:22.635819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 963/1928] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:22.635937 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-94bd26ab-d346-4514-82fd-8bd92b64ef20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:22.643392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00484bd8-94c0-4b31-a07d-0a601ff99b97 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.643683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00484bd8-94c0-4b31-a07d-0a601ff99b97 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.643960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00484bd8-94c0-4b31-a07d-0a601ff99b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.648724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd26ab-d346-4514-82fd-8bd92b64ef20 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:22.653252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2b4f6-b61f-4ee1-83de-85f4b35a84b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:22.653893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2b4f6-b61f-4ee1-83de-85f4b35a84b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.654175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2b4f6-b61f-4ee1-83de-85f4b35a84b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.654444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2b4f6-b61f-4ee1-83de-85f4b35a84b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.655077 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2b4f6-b61f-4ee1-83de-85f4b35a84b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:22.657009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2b4f6-b61f-4ee1-83de-85f4b35a84b9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:22.664657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-00484bd8-94c0-4b31-a07d-0a601ff99b97 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:22.665899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-00484bd8-94c0-4b31-a07d-0a601ff99b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:22.674498 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 964/1929] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:22.679161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00484bd8-94c0-4b31-a07d-0a601ff99b97 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:22.688232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00484bd8-94c0-4b31-a07d-0a601ff99b97 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:22.693208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba475e-6e49-46bd-ba1a-9f76c4a0df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:22.694053 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba475e-6e49-46bd-ba1a-9f76c4a0df96 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.694339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba475e-6e49-46bd-ba1a-9f76c4a0df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.694619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba475e-6e49-46bd-ba1a-9f76c4a0df96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.695270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba475e-6e49-46bd-ba1a-9f76c4a0df96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:22.695580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba475e-6e49-46bd-ba1a-9f76c4a0df96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:22.697351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba475e-6e49-46bd-ba1a-9f76c4a0df96 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:22.710081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 965/1930] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:29:22.714220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba475e-6e49-46bd-ba1a-9f76c4a0df96 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:22.724377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba475e-6e49-46bd-ba1a-9f76c4a0df96 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:22.729061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ffd24-726a-48a6-9e15-5d8942dac9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:22.729646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ffd24-726a-48a6-9e15-5d8942dac9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.729962 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ffd24-726a-48a6-9e15-5d8942dac9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.730242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ffd24-726a-48a6-9e15-5d8942dac9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.730873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ffd24-726a-48a6-9e15-5d8942dac9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:22.732794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ffd24-726a-48a6-9e15-5d8942dac9c9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:22.797101 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 966/1931] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:22 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:22.801242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2b4f6-b61f-4ee1-83de-85f4b35a84b9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:22.861884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 966/1932] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:22 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:22.866593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ffd24-726a-48a6-9e15-5d8942dac9c9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:22.867574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2b4f6-b61f-4ee1-83de-85f4b35a84b9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:22.930127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3b711-90db-4810-8c68-a3fc216880cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:22.930127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3b711-90db-4810-8c68-a3fc216880cc admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.930127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3b711-90db-4810-8c68-a3fc216880cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.930127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3b711-90db-4810-8c68-a3fc216880cc admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.930469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3b711-90db-4810-8c68-a3fc216880cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:22.931737 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3b711-90db-4810-8c68-a3fc216880cc admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:22.938406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ffd24-726a-48a6-9e15-5d8942dac9c9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:22.944908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9d1b-418f-4176-8900-a719c403fe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:22.945546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9d1b-418f-4176-8900-a719c403fe76 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:22.945848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9d1b-418f-4176-8900-a719c403fe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:22.946121 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9d1b-418f-4176-8900-a719c403fe76 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:22.946768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b9d1b-418f-4176-8900-a719c403fe76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:22.948862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b9d1b-418f-4176-8900-a719c403fe76 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:23.146985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 967/1933] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:22 2022] POST /identity/v3/users => generated 292 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:23.150921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3b711-90db-4810-8c68-a3fc216880cc admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:23.161199 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3b711-90db-4810-8c68-a3fc216880cc admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:23.166698 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7361d-76da-4a92-b1af-24cc412a92f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:23.167343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7361d-76da-4a92-b1af-24cc412a92f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:23.167622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7361d-76da-4a92-b1af-24cc412a92f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:23.168071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7361d-76da-4a92-b1af-24cc412a92f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:23.168731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7361d-76da-4a92-b1af-24cc412a92f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:23.170362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7361d-76da-4a92-b1af-24cc412a92f8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:23.182475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 968/1934] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:23.188684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 967/1935] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:22 2022] POST /identity/v3/users => generated 295 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:23.190340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7361d-76da-4a92-b1af-24cc412a92f8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:23.192756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9d1b-418f-4176-8900-a719c403fe76 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:23.200837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7361d-76da-4a92-b1af-24cc412a92f8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:23.203575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9d1b-418f-4176-8900-a719c403fe76 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:23.205809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb44c26-60e1-465c-99b9-f928ca904ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:23.206614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb44c26-60e1-465c-99b9-f928ca904ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:23.210697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb44c26-60e1-465c-99b9-f928ca904ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:23.210697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb44c26-60e1-465c-99b9-f928ca904ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:23.210697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb44c26-60e1-465c-99b9-f928ca904ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:23.210910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce5841-d833-4a4e-bf46-eca2d01f7481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:23.210996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb44c26-60e1-465c-99b9-f928ca904ccb admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:23.211080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce5841-d833-4a4e-bf46-eca2d01f7481 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:23.211080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce5841-d833-4a4e-bf46-eca2d01f7481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:23.211202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce5841-d833-4a4e-bf46-eca2d01f7481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:23.211788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce5841-d833-4a4e-bf46-eca2d01f7481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:23.213410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce5841-d833-4a4e-bf46-eca2d01f7481 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:23.225719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 969/1936] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:23.226631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb44c26-60e1-465c-99b9-f928ca904ccb admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:23.228321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 968/1937] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:23.229571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce5841-d833-4a4e-bf46-eca2d01f7481 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:23.237189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb44c26-60e1-465c-99b9-f928ca904ccb admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:23.240366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce5841-d833-4a4e-bf46-eca2d01f7481 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:23.242064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c70aa-dcab-472d-a987-a7829ada0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:23.242970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c70aa-dcab-472d-a987-a7829ada0861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:23.243406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c70aa-dcab-472d-a987-a7829ada0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:23.243856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c70aa-dcab-472d-a987-a7829ada0861 admin admin] PATH_INFO: `/v3/projects/047312db54404a51817a0818715caae6/users/453e0698a78d4efd9f3723a9b976090f/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:23.245567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9c6bf-568c-4a3f-a72e-63fb208c775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:23.246206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c6bf-568c-4a3f-a72e-63fb208c775d admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:23.246518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c6bf-568c-4a3f-a72e-63fb208c775d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:23.246800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c6bf-568c-4a3f-a72e-63fb208c775d admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:23.247476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9c6bf-568c-4a3f-a72e-63fb208c775d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:23.249285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9c6bf-568c-4a3f-a72e-63fb208c775d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:23.259180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c70aa-dcab-472d-a987-a7829ada0861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=047312db54404a51817a0818715caae6, user_id=453e0698a78d4efd9f3723a9b976090f, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:23.261033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 969/1938] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:23.261985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c70aa-dcab-472d-a987-a7829ada0861 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:23.266263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9c6bf-568c-4a3f-a72e-63fb208c775d admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:23.276472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9c6bf-568c-4a3f-a72e-63fb208c775d admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:23.280943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee506b35-12ca-4071-b4a5-24e21d7d584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:23.281730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee506b35-12ca-4071-b4a5-24e21d7d584d admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:23.282016 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee506b35-12ca-4071-b4a5-24e21d7d584d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:23.282296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee506b35-12ca-4071-b4a5-24e21d7d584d admin admin] PATH_INFO: `/v3/projects/aa2b94f00d5544d7be8ed6ffb367402c/users/4e9efc13d7eb45be81b434fbfbf1af95/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:23.297381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee506b35-12ca-4071-b4a5-24e21d7d584d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2b94f00d5544d7be8ed6ffb367402c, user_id=4e9efc13d7eb45be81b434fbfbf1af95, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:23.300762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee506b35-12ca-4071-b4a5-24e21d7d584d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:23.507432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 970/1939] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:23 2022] PUT /identity/v3/projects/047312db54404a51817a0818715caae6/users/453e0698a78d4efd9f3723a9b976090f/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:23.517764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4008b-8ef2-4e8a-9da6-289d60a052c8 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:23.518045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4008b-8ef2-4e8a-9da6-289d60a052c8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:23.518336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4008b-8ef2-4e8a-9da6-289d60a052c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:23.548017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-95d4008b-8ef2-4e8a-9da6-289d60a052c8 None None] MFA Rules not processed for user `453e0698a78d4efd9f3723a9b976090f`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:23.549234 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-95d4008b-8ef2-4e8a-9da6-289d60a052c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:23.627101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 970/1940] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:23 2022] PUT /identity/v3/projects/aa2b94f00d5544d7be8ed6ffb367402c/users/4e9efc13d7eb45be81b434fbfbf1af95/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:23.634860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 971/1941] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:23.639288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4008b-8ef2-4e8a-9da6-289d60a052c8 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:23.639426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb471f-c842-4d00-960d-2d984854dd25 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:23.639594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb471f-c842-4d00-960d-2d984854dd25 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:23.639870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb471f-c842-4d00-960d-2d984854dd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:23.669243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-29cb471f-c842-4d00-960d-2d984854dd25 None None] MFA Rules not processed for user `4e9efc13d7eb45be81b434fbfbf1af95`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:23.670486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-29cb471f-c842-4d00-960d-2d984854dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:23.704516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4008b-8ef2-4e8a-9da6-289d60a052c8 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:23.735582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 971/1942] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:23.740677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb471f-c842-4d00-960d-2d984854dd25 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:23.763064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d694e-b018-459d-bbd8-e607d2a4a4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:23.763693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d694e-b018-459d-bbd8-e607d2a4a4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:23.763980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d694e-b018-459d-bbd8-e607d2a4a4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:23.764279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d694e-b018-459d-bbd8-e607d2a4a4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:23.764996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d694e-b018-459d-bbd8-e607d2a4a4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:23.766974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d694e-b018-459d-bbd8-e607d2a4a4c5 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:23.871963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb471f-c842-4d00-960d-2d984854dd25 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:23.877018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace68b6a-e8f3-4cf6-9a88-afeda7fca5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:23.877632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68b6a-e8f3-4cf6-9a88-afeda7fca5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:23.877952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68b6a-e8f3-4cf6-9a88-afeda7fca5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:23.878230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68b6a-e8f3-4cf6-9a88-afeda7fca5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:23.878867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace68b6a-e8f3-4cf6-9a88-afeda7fca5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:23.881356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace68b6a-e8f3-4cf6-9a88-afeda7fca5c5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:23.968671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 972/1943] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:23 2022] POST /identity/v3/projects => generated 387 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:23.986498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d694e-b018-459d-bbd8-e607d2a4a4c5 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:24.020509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 972/1944] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:23 2022] POST /identity/v3/projects => generated 387 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:24.024155 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace68b6a-e8f3-4cf6-9a88-afeda7fca5c5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:24.077254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d694e-b018-459d-bbd8-e607d2a4a4c5 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:24.106382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace68b6a-e8f3-4cf6-9a88-afeda7fca5c5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:24.111712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff8266-0005-48b6-a430-e1b917aa7310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:24.112443 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff8266-0005-48b6-a430-e1b917aa7310 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:24.112866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff8266-0005-48b6-a430-e1b917aa7310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:24.113245 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff8266-0005-48b6-a430-e1b917aa7310 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:24.114077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff8266-0005-48b6-a430-e1b917aa7310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:24.116807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff8266-0005-48b6-a430-e1b917aa7310 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:24.158201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12266b96-cdbc-4b30-9991-20eb59376a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:24.158878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266b96-cdbc-4b30-9991-20eb59376a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:24.159099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266b96-cdbc-4b30-9991-20eb59376a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:24.159381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266b96-cdbc-4b30-9991-20eb59376a08 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:24.163392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12266b96-cdbc-4b30-9991-20eb59376a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:24.163392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12266b96-cdbc-4b30-9991-20eb59376a08 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:24.507946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 973/1945] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:24 2022] POST /identity/v3/users => generated 300 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:24.509696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff8266-0005-48b6-a430-e1b917aa7310 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:24.511429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a4ff8266-0005-48b6-a430-e1b917aa7310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:24.524068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff8266-0005-48b6-a430-e1b917aa7310 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:24.533232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:24.533899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:24.534193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:24.534463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] PATH_INFO: `/v3/users/91c973a10f2041c0a012aa38b591a743` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:24.535593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c973a10f2041c0a012aa38b591a743)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:24.537505 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:24.595752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 973/1946] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:23 2022] POST /identity/v3/users => generated 300 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:24.595752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12266b96-cdbc-4b30-9991-20eb59376a08 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:24.625372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12266b96-cdbc-4b30-9991-20eb59376a08 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:24.625372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0878aa-366b-467a-998f-cd161165d8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:24.625372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0878aa-366b-467a-998f-cd161165d8eb admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:24.625372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0878aa-366b-467a-998f-cd161165d8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:24.626039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0878aa-366b-467a-998f-cd161165d8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:24.626039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0878aa-366b-467a-998f-cd161165d8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:24.626039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0878aa-366b-467a-998f-cd161165d8eb admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:24.627364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 974/1947] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:24.628361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0878aa-366b-467a-998f-cd161165d8eb admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:24.643217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0878aa-366b-467a-998f-cd161165d8eb admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:24.648359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61c76e-07c8-4528-82e9-133ee29c97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:24.648981 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61c76e-07c8-4528-82e9-133ee29c97bb admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:24.649264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61c76e-07c8-4528-82e9-133ee29c97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:24.649544 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61c76e-07c8-4528-82e9-133ee29c97bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:24.650379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61c76e-07c8-4528-82e9-133ee29c97bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:24.651897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61c76e-07c8-4528-82e9-133ee29c97bb admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:24.664129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 975/1948] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:24.665394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61c76e-07c8-4528-82e9-133ee29c97bb admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:24.675274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61c76e-07c8-4528-82e9-133ee29c97bb admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:24.699497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca28929-663b-4451-8b94-b4993612eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:24.699497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca28929-663b-4451-8b94-b4993612eb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:24.699497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca28929-663b-4451-8b94-b4993612eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:24.699497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca28929-663b-4451-8b94-b4993612eb20 admin admin] PATH_INFO: `/v3/projects/9194d5f6b95543a983821a02a2dababc/users/e129cb4393274b8e92c6efdec0d3ebc3/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:24.699909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca28929-663b-4451-8b94-b4993612eb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9194d5f6b95543a983821a02a2dababc, user_id=e129cb4393274b8e92c6efdec0d3ebc3, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:24.701051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca28929-663b-4451-8b94-b4993612eb20 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:24.823510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 976/1949] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:24 2022] PUT /identity/v3/projects/9194d5f6b95543a983821a02a2dababc/users/e129cb4393274b8e92c6efdec0d3ebc3/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:24.824322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca28929-663b-4451-8b94-b4993612eb20 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:24.870204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c973a10f2041c0a012aa38b591a743'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:24.892843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca28929-663b-4451-8b94-b4993612eb20 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:24.897530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c5be-64cb-495d-9229-23cc7070e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:24.898228 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c5be-64cb-495d-9229-23cc7070e54a admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:24.898505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c5be-64cb-495d-9229-23cc7070e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:24.898782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c5be-64cb-495d-9229-23cc7070e54a admin admin] PATH_INFO: `/v3/projects/21845ab6dece4be0b451dc1d3240a3ae/users/0006beab53d7423789298f5e2fcfcc0f/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:24.913926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23c5be-64cb-495d-9229-23cc7070e54a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21845ab6dece4be0b451dc1d3240a3ae, user_id=0006beab53d7423789298f5e2fcfcc0f, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:24.916609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23c5be-64cb-495d-9229-23cc7070e54a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:24.966418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c973a10f2041c0a012aa38b591a743'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:24.967365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c973a10f2041c0a012aa38b591a743'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:24.980804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c973a10f2041c0a012aa38b591a743'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:24.981469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c973a10f2041c0a012aa38b591a743'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:24.994296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 974/1950] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:24 2022] DELETE /identity/v3/users/91c973a10f2041c0a012aa38b591a743 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:24.995898 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:24.997732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:25.032517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 977/1951] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:24 2022] PUT /identity/v3/projects/21845ab6dece4be0b451dc1d3240a3ae/users/0006beab53d7423789298f5e2fcfcc0f/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:25.034054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f133-7562-49cb-9b99-9b6d8bd2993e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.051718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f133-7562-49cb-9b99-9b6d8bd2993e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.051718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f133-7562-49cb-9b99-9b6d8bd2993e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.054522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9e04f133-7562-49cb-9b99-9b6d8bd2993e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:25.055727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9e04f133-7562-49cb-9b99-9b6d8bd2993e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:25.065624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55231338-c158-4ea0-bde2-96412849b028 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:25.120147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 978/1952] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:25.120147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f133-7562-49cb-9b99-9b6d8bd2993e None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:25.120147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9e04f133-7562-49cb-9b99-9b6d8bd2993e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:25.125137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d42a9-9de3-4e65-8465-e58376f9b195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:25.125960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d42a9-9de3-4e65-8465-e58376f9b195 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.126250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d42a9-9de3-4e65-8465-e58376f9b195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.126559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d42a9-9de3-4e65-8465-e58376f9b195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.127315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d42a9-9de3-4e65-8465-e58376f9b195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:25.128898 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d42a9-9de3-4e65-8465-e58376f9b195 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:25.131439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f133-7562-49cb-9b99-9b6d8bd2993e None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:25.136179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d74beb-6d40-481f-b833-2a0390ef4204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:25.136784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d74beb-6d40-481f-b833-2a0390ef4204 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.137185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d74beb-6d40-481f-b833-2a0390ef4204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.137466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d74beb-6d40-481f-b833-2a0390ef4204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.138142 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d74beb-6d40-481f-b833-2a0390ef4204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:25.139730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d74beb-6d40-481f-b833-2a0390ef4204 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:25.139844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 975/1953] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:25.140601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d42a9-9de3-4e65-8465-e58376f9b195 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:25.142364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ae0d42a9-9de3-4e65-8465-e58376f9b195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:25.154064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 979/1954] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:25.154064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d74beb-6d40-481f-b833-2a0390ef4204 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:25.163966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d74beb-6d40-481f-b833-2a0390ef4204 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:25.169088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c2981-c2a8-4284-b9bd-2419a77d73c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:25.173229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c2981-c2a8-4284-b9bd-2419a77d73c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.173229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c2981-c2a8-4284-b9bd-2419a77d73c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.173229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c2981-c2a8-4284-b9bd-2419a77d73c3 admin admin] PATH_INFO: `/v3/projects/9194d5f6b95543a983821a02a2dababc/users/e129cb4393274b8e92c6efdec0d3ebc3/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.173229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c2981-c2a8-4284-b9bd-2419a77d73c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9194d5f6b95543a983821a02a2dababc, user_id=e129cb4393274b8e92c6efdec0d3ebc3, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:25.175360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c2981-c2a8-4284-b9bd-2419a77d73c3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:25.187258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 980/1955] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:25 2022] PUT /identity/v3/projects/9194d5f6b95543a983821a02a2dababc/users/e129cb4393274b8e92c6efdec0d3ebc3/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:25.188050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c2981-c2a8-4284-b9bd-2419a77d73c3 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:25.203338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d42a9-9de3-4e65-8465-e58376f9b195 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:25.262947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e26fb-8cf0-409e-818f-ddba3ccbbb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:25.263306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c2981-c2a8-4284-b9bd-2419a77d73c3 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:25.263637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e26fb-8cf0-409e-818f-ddba3ccbbb45 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.264463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e26fb-8cf0-409e-818f-ddba3ccbbb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.264463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e26fb-8cf0-409e-818f-ddba3ccbbb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.268147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5266-8f44-4bd5-98ca-2726385dddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:25.269008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5266-8f44-4bd5-98ca-2726385dddbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.269342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5266-8f44-4bd5-98ca-2726385dddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.270270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5266-8f44-4bd5-98ca-2726385dddbc admin admin] PATH_INFO: `/v3/projects/21845ab6dece4be0b451dc1d3240a3ae/users/0006beab53d7423789298f5e2fcfcc0f/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.272961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b5266-8f44-4bd5-98ca-2726385dddbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=21845ab6dece4be0b451dc1d3240a3ae, user_id=0006beab53d7423789298f5e2fcfcc0f, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:25.275131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e26fb-8cf0-409e-818f-ddba3ccbbb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:25.276455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b5266-8f44-4bd5-98ca-2726385dddbc admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:25.276578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e26fb-8cf0-409e-818f-ddba3ccbbb45 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:25.288182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 981/1956] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:25 2022] PUT /identity/v3/projects/21845ab6dece4be0b451dc1d3240a3ae/users/0006beab53d7423789298f5e2fcfcc0f/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:25.288364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 976/1957] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:25.293640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aaf2f-c3a5-4ac5-b6c1-fc3c8ab3f2ba None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.293640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aaf2f-c3a5-4ac5-b6c1-fc3c8ab3f2ba None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.293640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aaf2f-c3a5-4ac5-b6c1-fc3c8ab3f2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.300418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a847-958e-43f8-8609-aae8ba39c9f8 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.300741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a847-958e-43f8-8609-aae8ba39c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.301066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a847-958e-43f8-8609-aae8ba39c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.321790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-382aaf2f-c3a5-4ac5-b6c1-fc3c8ab3f2ba None None] MFA Rules not processed for user `e129cb4393274b8e92c6efdec0d3ebc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:25.323276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-382aaf2f-c3a5-4ac5-b6c1-fc3c8ab3f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:25.340790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a222a847-958e-43f8-8609-aae8ba39c9f8 None None] MFA Rules not processed for user `0006beab53d7423789298f5e2fcfcc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:25.342161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a222a847-958e-43f8-8609-aae8ba39c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:25.399498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 982/1958] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:25.411006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aaf2f-c3a5-4ac5-b6c1-fc3c8ab3f2ba None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:25.413191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-382aaf2f-c3a5-4ac5-b6c1-fc3c8ab3f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:25.425723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 977/1959] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:25.437380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222a847-958e-43f8-8609-aae8ba39c9f8 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:25.438828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a222a847-958e-43f8-8609-aae8ba39c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:25.471128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aaf2f-c3a5-4ac5-b6c1-fc3c8ab3f2ba None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:25.475929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210c59-63a8-4aae-8de4-43031bf13fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:25.476617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210c59-63a8-4aae-8de4-43031bf13fbc service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.476840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210c59-63a8-4aae-8de4-43031bf13fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.477251 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210c59-63a8-4aae-8de4-43031bf13fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.487613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210c59-63a8-4aae-8de4-43031bf13fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:25.489041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210c59-63a8-4aae-8de4-43031bf13fbc service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:25.499440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 983/1960] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:25.501693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222a847-958e-43f8-8609-aae8ba39c9f8 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:25.510406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c705b3a-8956-4814-89c0-b8b88a9e2ae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:25.510406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c705b3a-8956-4814-89c0-b8b88a9e2ae4 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.510406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c705b3a-8956-4814-89c0-b8b88a9e2ae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.510406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c705b3a-8956-4814-89c0-b8b88a9e2ae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.519460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c705b3a-8956-4814-89c0-b8b88a9e2ae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:25.521638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c705b3a-8956-4814-89c0-b8b88a9e2ae4 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:25.535818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 978/1961] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:25.623557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210c59-63a8-4aae-8de4-43031bf13fbc service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:25.669245 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c705b3a-8956-4814-89c0-b8b88a9e2ae4 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:25.723121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210c59-63a8-4aae-8de4-43031bf13fbc service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:25.730375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:25.731060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.731449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.731952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] PATH_INFO: `/v3/users/453e0698a78d4efd9f3723a9b976090f` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.733780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453e0698a78d4efd9f3723a9b976090f)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:25.739245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:25.755881 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c705b3a-8956-4814-89c0-b8b88a9e2ae4 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:25.760625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:25.761267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:25.761581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:25.761907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] PATH_INFO: `/v3/users/4e9efc13d7eb45be81b434fbfbf1af95` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:25.763395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9efc13d7eb45be81b434fbfbf1af95)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:25.765427 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:26.015213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453e0698a78d4efd9f3723a9b976090f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.015876 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453e0698a78d4efd9f3723a9b976090f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.017110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453e0698a78d4efd9f3723a9b976090f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.129180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9efc13d7eb45be81b434fbfbf1af95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.149650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453e0698a78d4efd9f3723a9b976090f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.164618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453e0698a78d4efd9f3723a9b976090f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.177970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 984/1962] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:25 2022] DELETE /identity/v3/users/453e0698a78d4efd9f3723a9b976090f => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:26.178875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:26.180242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:26.243808 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505db75c-0cc9-45aa-8f32-703951e6e2b2 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:26.248430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:26.249071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:26.249353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:26.249633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] PATH_INFO: `/v3/projects/ebc687adc6f54c6495888ebbfa548aab` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:26.250784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc687adc6f54c6495888ebbfa548aab)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:26.252739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:26.266332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9efc13d7eb45be81b434fbfbf1af95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.268062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9efc13d7eb45be81b434fbfbf1af95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.281302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9efc13d7eb45be81b434fbfbf1af95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.282045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a621f97c-af81-4ec4-9572-ec884ba97f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9efc13d7eb45be81b434fbfbf1af95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.294168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 979/1963] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:25 2022] DELETE /identity/v3/users/4e9efc13d7eb45be81b434fbfbf1af95 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:26.295535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75b083-52f2-4365-a88f-91d7f76ee850 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:26.295895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75b083-52f2-4365-a88f-91d7f76ee850 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:26.296371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75b083-52f2-4365-a88f-91d7f76ee850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:26.315931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-0f75b083-52f2-4365-a88f-91d7f76ee850 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:26.317139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0f75b083-52f2-4365-a88f-91d7f76ee850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:26.380318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 980/1964] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:26.381917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141794a2-054d-498f-bbe3-5c46923e1786 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:26.385360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141794a2-054d-498f-bbe3-5c46923e1786 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:26.385360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141794a2-054d-498f-bbe3-5c46923e1786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:26.394720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc687adc6f54c6495888ebbfa548aab', 'request_id': 'req-9227602f-1f3e-4f08-9232-421f141fafce'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.401350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc687adc6f54c6495888ebbfa548aab', 'request_id': 'req-9227602f-1f3e-4f08-9232-421f141fafce'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.401872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-141794a2-054d-498f-bbe3-5c46923e1786 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:26.403108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-141794a2-054d-498f-bbe3-5c46923e1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:26.462713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 981/1965] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:26.463629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141794a2-054d-498f-bbe3-5c46923e1786 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:26.464973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-141794a2-054d-498f-bbe3-5c46923e1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:26.520778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141794a2-054d-498f-bbe3-5c46923e1786 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:26.524886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f591c6f-0410-48a6-a4d2-a1281413c544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:26.525492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f591c6f-0410-48a6-a4d2-a1281413c544 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:26.525809 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f591c6f-0410-48a6-a4d2-a1281413c544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:26.526087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f591c6f-0410-48a6-a4d2-a1281413c544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:26.535233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f591c6f-0410-48a6-a4d2-a1281413c544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:26.536725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f591c6f-0410-48a6-a4d2-a1281413c544 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:26.553178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc687adc6f54c6495888ebbfa548aab', 'request_id': 'req-9227602f-1f3e-4f08-9232-421f141fafce'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.559993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 982/1966] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:26.561176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f591c6f-0410-48a6-a4d2-a1281413c544 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:26.581620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] The token cache is being invalidate because project ebc687adc6f54c6495888ebbfa548aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:26.582269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.584426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:26.584628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f591c6f-0410-48a6-a4d2-a1281413c544 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:26.590286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 985/1967] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:26 2022] DELETE /identity/v3/projects/ebc687adc6f54c6495888ebbfa548aab => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:26.591234 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:26.593023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:26.596085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c18e1-e7a9-4258-8946-84de729fa305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:26.597254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c18e1-e7a9-4258-8946-84de729fa305 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:26.600362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c18e1-e7a9-4258-8946-84de729fa305 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:26.600853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c18e1-e7a9-4258-8946-84de729fa305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:26.609249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227602f-1f3e-4f08-9232-421f141fafce admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:26.611575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8c3c18e1-e7a9-4258-8946-84de729fa305 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:26.614805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:26.615582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:26.615921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:26.616271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] PATH_INFO: `/v3/users/9c1629b0fec84f3bb3b613395f6407f3` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:26.617481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1629b0fec84f3bb3b613395f6407f3)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:26.619537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:26.629948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c18e1-e7a9-4258-8946-84de729fa305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:26.632578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c18e1-e7a9-4258-8946-84de729fa305 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:26.648098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 983/1968] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:26.992587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:27.096737 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1629b0fec84f3bb3b613395f6407f3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:27.098088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1629b0fec84f3bb3b613395f6407f3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:27.098568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1629b0fec84f3bb3b613395f6407f3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:27.241445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1629b0fec84f3bb3b613395f6407f3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:27.256794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1629b0fec84f3bb3b613395f6407f3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:27.271463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 986/1969] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:26 2022] DELETE /identity/v3/users/9c1629b0fec84f3bb3b613395f6407f3 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:27.575283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:27.635001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:27.635220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c18e1-e7a9-4258-8946-84de729fa305 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:27.635312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:27.635489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8c3c18e1-e7a9-4258-8946-84de729fa305 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:27.658658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c18e1-e7a9-4258-8946-84de729fa305 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:27.741972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:27.750848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:27.750988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924fbb2-6997-4c5a-b922-43977ace3fb2 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:27.751093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:27.751093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] PATH_INFO: `/v3/projects/047312db54404a51817a0818715caae6` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:27.751093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=047312db54404a51817a0818715caae6)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:27.751093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:27.751423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:27.751423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:27.751423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:27.751423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] PATH_INFO: `/v3/projects/aa2b94f00d5544d7be8ed6ffb367402c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:27.751728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2b94f00d5544d7be8ed6ffb367402c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:27.752096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:27.940551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '047312db54404a51817a0818715caae6', 'request_id': 'req-a4ac929f-d850-4c10-b738-dddea32bb0d3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:27.947328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '047312db54404a51817a0818715caae6', 'request_id': 'req-a4ac929f-d850-4c10-b738-dddea32bb0d3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:27.990438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2b94f00d5544d7be8ed6ffb367402c', 'request_id': 'req-5de34c5f-cca5-49cf-af62-2a5597e71944'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:27.997991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2b94f00d5544d7be8ed6ffb367402c', 'request_id': 'req-5de34c5f-cca5-49cf-af62-2a5597e71944'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.075320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '047312db54404a51817a0818715caae6', 'request_id': 'req-a4ac929f-d850-4c10-b738-dddea32bb0d3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.088194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] The token cache is being invalidate because project 047312db54404a51817a0818715caae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:28.088416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.089108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.090843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 984/1970] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:27 2022] DELETE /identity/v3/projects/047312db54404a51817a0818715caae6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:28.091630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:28.092912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:28.158832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac929f-d850-4c10-b738-dddea32bb0d3 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:28.220038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:28.220679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:28.220960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:28.221234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] PATH_INFO: `/v3/projects/976324cbce414cac8b6c7a0ff2ed42b9` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:28.222417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=976324cbce414cac8b6c7a0ff2ed42b9)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:28.224374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:28.232780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2b94f00d5544d7be8ed6ffb367402c', 'request_id': 'req-5de34c5f-cca5-49cf-af62-2a5597e71944'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.247857 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] The token cache is being invalidate because project aa2b94f00d5544d7be8ed6ffb367402c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:28.248141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.249185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.251123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 987/1971] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:27 2022] DELETE /identity/v3/projects/aa2b94f00d5544d7be8ed6ffb367402c => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:28.251986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:28.253832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:28.270543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de34c5f-cca5-49cf-af62-2a5597e71944 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:28.275943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:28.276759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:28.277290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:28.277752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] PATH_INFO: `/v3/users/0006beab53d7423789298f5e2fcfcc0f` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:28.279311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0006beab53d7423789298f5e2fcfcc0f)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:28.281937 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:28.370044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976324cbce414cac8b6c7a0ff2ed42b9', 'request_id': 'req-628517e8-8795-4ab0-82cd-294d1dd93f9a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.376286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976324cbce414cac8b6c7a0ff2ed42b9', 'request_id': 'req-628517e8-8795-4ab0-82cd-294d1dd93f9a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.457501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976324cbce414cac8b6c7a0ff2ed42b9', 'request_id': 'req-628517e8-8795-4ab0-82cd-294d1dd93f9a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.469308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] The token cache is being invalidate because project 976324cbce414cac8b6c7a0ff2ed42b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:28.469727 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.470444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.471972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 985/1972] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:28 2022] DELETE /identity/v3/projects/976324cbce414cac8b6c7a0ff2ed42b9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:28.473431 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:28.474767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:28.505633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0006beab53d7423789298f5e2fcfcc0f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.506363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0006beab53d7423789298f5e2fcfcc0f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.507147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0006beab53d7423789298f5e2fcfcc0f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.566518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628517e8-8795-4ab0-82cd-294d1dd93f9a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:28.576649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:28.576649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:28.576649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:28.576649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] PATH_INFO: `/v3/users/e129cb4393274b8e92c6efdec0d3ebc3` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:28.577444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e129cb4393274b8e92c6efdec0d3ebc3)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:28.577684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:28.601733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0006beab53d7423789298f5e2fcfcc0f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.621346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0006beab53d7423789298f5e2fcfcc0f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:28.628316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 988/1973] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:28 2022] DELETE /identity/v3/users/0006beab53d7423789298f5e2fcfcc0f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:28.629209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:28.631320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:28.713257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedadde-e65a-4873-a909-dd2cdcaaa442 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:28.719287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:28.719994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:28.720279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:28.720559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] PATH_INFO: `/v3/users/b226b17eecd946989e4d8c4542ad5229` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:28.722236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b226b17eecd946989e4d8c4542ad5229)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:28.724283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:28.988278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e129cb4393274b8e92c6efdec0d3ebc3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.084506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e129cb4393274b8e92c6efdec0d3ebc3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.085539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e129cb4393274b8e92c6efdec0d3ebc3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.105700 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b226b17eecd946989e4d8c4542ad5229'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.106503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b226b17eecd946989e4d8c4542ad5229'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.107219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b226b17eecd946989e4d8c4542ad5229'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.120143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e129cb4393274b8e92c6efdec0d3ebc3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.121124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e129cb4393274b8e92c6efdec0d3ebc3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.142102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 986/1974] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:28 2022] DELETE /identity/v3/users/e129cb4393274b8e92c6efdec0d3ebc3 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:29.257864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b226b17eecd946989e4d8c4542ad5229'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.270632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-015a521e-a76d-461b-b410-e010ed4d5e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b226b17eecd946989e4d8c4542ad5229'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.283730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 989/1975] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:28 2022] DELETE /identity/v3/users/b226b17eecd946989e4d8c4542ad5229 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:29.348109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:29.349646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:29.472198 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038deea3-b1a6-4557-829c-0a9f699860b3 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:29.532079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:29.533326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:29.533652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:29.533963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] PATH_INFO: `/v3/projects/21845ab6dece4be0b451dc1d3240a3ae` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:29.535146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21845ab6dece4be0b451dc1d3240a3ae)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:29.537109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:29.686429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21845ab6dece4be0b451dc1d3240a3ae', 'request_id': 'req-c262f478-cc91-4a76-9f2a-116a26892dc4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.694315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21845ab6dece4be0b451dc1d3240a3ae', 'request_id': 'req-c262f478-cc91-4a76-9f2a-116a26892dc4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.772776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21845ab6dece4be0b451dc1d3240a3ae', 'request_id': 'req-c262f478-cc91-4a76-9f2a-116a26892dc4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.787276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] The token cache is being invalidate because project 21845ab6dece4be0b451dc1d3240a3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:29.787639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.788518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c262f478-cc91-4a76-9f2a-116a26892dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:29.794059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 987/1976] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:29 2022] DELETE /identity/v3/projects/21845ab6dece4be0b451dc1d3240a3ae => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:29.796943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6ac8-844f-48a6-8e59-9ffa3b682808 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:29.797275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6ac8-844f-48a6-8e59-9ffa3b682808 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:29.797763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6ac8-844f-48a6-8e59-9ffa3b682808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:29.830751 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-729a6ac8-844f-48a6-8e59-9ffa3b682808 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:29.831782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-729a6ac8-844f-48a6-8e59-9ffa3b682808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:29.930746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 990/1977] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:29.938520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7898-4df5-4089-8d5f-c179be0b0c83 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:29.939338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7898-4df5-4089-8d5f-c179be0b0c83 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:29.939338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7898-4df5-4089-8d5f-c179be0b0c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:29.959976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-570e7898-4df5-4089-8d5f-c179be0b0c83 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:29.961172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-570e7898-4df5-4089-8d5f-c179be0b0c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:29.969680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 988/1978] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:29.974074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a6ac8-844f-48a6-8e59-9ffa3b682808 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.001413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a6ac8-844f-48a6-8e59-9ffa3b682808 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.001413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db518ba1-c321-4a94-b423-0b084ae998f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.001413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db518ba1-c321-4a94-b423-0b084ae998f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.001413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db518ba1-c321-4a94-b423-0b084ae998f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.001839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db518ba1-c321-4a94-b423-0b084ae998f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.001839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db518ba1-c321-4a94-b423-0b084ae998f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:30.001839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db518ba1-c321-4a94-b423-0b084ae998f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.001839 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db518ba1-c321-4a94-b423-0b084ae998f8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:30.006459 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 991/1979] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:30.010976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7898-4df5-4089-8d5f-c179be0b0c83 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.020231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7898-4df5-4089-8d5f-c179be0b0c83 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.024975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892b417-efbb-4780-8d3f-9cb6961da394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.025628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892b417-efbb-4780-8d3f-9cb6961da394 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.025969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892b417-efbb-4780-8d3f-9cb6961da394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.026246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892b417-efbb-4780-8d3f-9cb6961da394 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.026937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892b417-efbb-4780-8d3f-9cb6961da394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.028827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892b417-efbb-4780-8d3f-9cb6961da394 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:30.074449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db518ba1-c321-4a94-b423-0b084ae998f8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.076446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-db518ba1-c321-4a94-b423-0b084ae998f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:30.090568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db518ba1-c321-4a94-b423-0b084ae998f8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.095418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.096053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.096332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.096607 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] PATH_INFO: `/v3/projects/33ca04df613448d9b458132181970eef` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.097783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ca04df613448d9b458132181970eef)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.100408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:30.162671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 989/1980] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:30 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:30.169930 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892b417-efbb-4780-8d3f-9cb6961da394 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.169930 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6892b417-efbb-4780-8d3f-9cb6961da394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:30.230238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892b417-efbb-4780-8d3f-9cb6961da394 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.234929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.235588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.235879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.236161 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] PATH_INFO: `/v3/projects/9194d5f6b95543a983821a02a2dababc` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.237309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9194d5f6b95543a983821a02a2dababc)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.239268 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:30.332536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ca04df613448d9b458132181970eef', 'request_id': 'req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:30.339512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ca04df613448d9b458132181970eef', 'request_id': 'req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:30.492017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ca04df613448d9b458132181970eef', 'request_id': 'req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:30.506900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] The token cache is being invalidate because project 33ca04df613448d9b458132181970eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:30.507289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:30.508046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:30.514373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 992/1981] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:30 2022] DELETE /identity/v3/projects/33ca04df613448d9b458132181970eef => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:30.514559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9194d5f6b95543a983821a02a2dababc', 'request_id': 'req-769eb4ac-d266-4308-8a1b-772622a70aac'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:30.514653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.514653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:30.516383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9194d5f6b95543a983821a02a2dababc', 'request_id': 'req-769eb4ac-d266-4308-8a1b-772622a70aac'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:30.582307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bcf7b-633c-402e-8a2d-afb16f0fdfc1 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.644569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f2ea0-f9aa-41f6-ab00-e45adc8362d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.645199 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f2ea0-f9aa-41f6-ab00-e45adc8362d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.645479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f2ea0-f9aa-41f6-ab00-e45adc8362d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.645783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f2ea0-f9aa-41f6-ab00-e45adc8362d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.646973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f2ea0-f9aa-41f6-ab00-e45adc8362d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.649002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f2ea0-f9aa-41f6-ab00-e45adc8362d0 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:30.710394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9194d5f6b95543a983821a02a2dababc', 'request_id': 'req-769eb4ac-d266-4308-8a1b-772622a70aac'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:30.721465 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] The token cache is being invalidate because project 9194d5f6b95543a983821a02a2dababc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:30.721791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:30.722466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-769eb4ac-d266-4308-8a1b-772622a70aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:30.724649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 990/1982] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:30 2022] DELETE /identity/v3/projects/9194d5f6b95543a983821a02a2dababc => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:30.728097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550fa4-214a-4046-814f-baf239b08d28 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.728097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550fa4-214a-4046-814f-baf239b08d28 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.728097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550fa4-214a-4046-814f-baf239b08d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.746655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:30.748351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-5a550fa4-214a-4046-814f-baf239b08d28 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:30.749602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-5a550fa4-214a-4046-814f-baf239b08d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:30.757829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 991/1983] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:30.759057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbac94b-c11c-4164-9840-c6d17167f6e1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.759346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbac94b-c11c-4164-9840-c6d17167f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.759619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbac94b-c11c-4164-9840-c6d17167f6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.779713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3bbac94b-c11c-4164-9840-c6d17167f6e1 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:30.780918 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3bbac94b-c11c-4164-9840-c6d17167f6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:30.789167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 992/1984] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:30.791152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b596a-0675-4e8f-9385-d3e485f61858 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.791446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b596a-0675-4e8f-9385-d3e485f61858 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.791729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b596a-0675-4e8f-9385-d3e485f61858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.811280 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b27b596a-0675-4e8f-9385-d3e485f61858 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:30.812422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b27b596a-0675-4e8f-9385-d3e485f61858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:30.820813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 993/1985] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:30.822411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694dc6f-2d1a-414d-80fc-678bb3844ccf None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.822706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694dc6f-2d1a-414d-80fc-678bb3844ccf None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.822979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694dc6f-2d1a-414d-80fc-678bb3844ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.834982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 993/1986] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:30 2022] POST /identity/v3/users => generated 291 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:30.834982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f2ea0-f9aa-41f6-ab00-e45adc8362d0 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.842933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f2ea0-f9aa-41f6-ab00-e45adc8362d0 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.844489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-6694dc6f-2d1a-414d-80fc-678bb3844ccf None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:30.844778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6694dc6f-2d1a-414d-80fc-678bb3844ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:30.848067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f317e34-1122-456a-94a6-ba66bb122595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.848741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f317e34-1122-456a-94a6-ba66bb122595 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.849695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f317e34-1122-456a-94a6-ba66bb122595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.850052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f317e34-1122-456a-94a6-ba66bb122595 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.850779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f317e34-1122-456a-94a6-ba66bb122595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:30.851134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f317e34-1122-456a-94a6-ba66bb122595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.852780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f317e34-1122-456a-94a6-ba66bb122595 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:30.853225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 994/1987] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:30.854051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694dc6f-2d1a-414d-80fc-678bb3844ccf None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.856195 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6694dc6f-2d1a-414d-80fc-678bb3844ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:30.868005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694dc6f-2d1a-414d-80fc-678bb3844ccf None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.868193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 994/1988] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:30.868974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f317e34-1122-456a-94a6-ba66bb122595 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.873080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a8955-1750-42e8-8000-62657d80e412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.891051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a8955-1750-42e8-8000-62657d80e412 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.891051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a8955-1750-42e8-8000-62657d80e412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.891051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a8955-1750-42e8-8000-62657d80e412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.891051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a8955-1750-42e8-8000-62657d80e412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.891051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a8955-1750-42e8-8000-62657d80e412 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:30.891470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f317e34-1122-456a-94a6-ba66bb122595 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.891470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ae184-44fb-42b2-883b-4f21e671666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.891470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ae184-44fb-42b2-883b-4f21e671666f admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.891470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ae184-44fb-42b2-883b-4f21e671666f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.891793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ae184-44fb-42b2-883b-4f21e671666f admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.891793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ae184-44fb-42b2-883b-4f21e671666f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:30.891793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ae184-44fb-42b2-883b-4f21e671666f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.891793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ae184-44fb-42b2-883b-4f21e671666f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:30.892521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 995/1989] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:30.892521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a8955-1750-42e8-8000-62657d80e412 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.903864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 995/1990] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:30.904756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ae184-44fb-42b2-883b-4f21e671666f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.907287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a8955-1750-42e8-8000-62657d80e412 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.912345 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b292-4616-4d46-837c-478be7aa0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.913321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b292-4616-4d46-837c-478be7aa0b45 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.913607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b292-4616-4d46-837c-478be7aa0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.918949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b292-4616-4d46-837c-478be7aa0b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.918949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874b292-4616-4d46-837c-478be7aa0b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.919185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ae184-44fb-42b2-883b-4f21e671666f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.919277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874b292-4616-4d46-837c-478be7aa0b45 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:30.920166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9dec-639e-44c3-b238-c83f6d19d17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.920867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9dec-639e-44c3-b238-c83f6d19d17c admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.921220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9dec-639e-44c3-b238-c83f6d19d17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.921703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9dec-639e-44c3-b238-c83f6d19d17c admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.922247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9dec-639e-44c3-b238-c83f6d19d17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.923825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9dec-639e-44c3-b238-c83f6d19d17c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:30.935468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 996/1991] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:30.935468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9dec-639e-44c3-b238-c83f6d19d17c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:30.948579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9dec-639e-44c3-b238-c83f6d19d17c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:30.953551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce86ec3-4bc1-4bd3-9925-69f791a203ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:30.954187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce86ec3-4bc1-4bd3-9925-69f791a203ca admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:30.954464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce86ec3-4bc1-4bd3-9925-69f791a203ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:30.954739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce86ec3-4bc1-4bd3-9925-69f791a203ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:30.955464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce86ec3-4bc1-4bd3-9925-69f791a203ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:30.957334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce86ec3-4bc1-4bd3-9925-69f791a203ca admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:31.026523 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 996/1992] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:30 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:31.026523 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b292-4616-4d46-837c-478be7aa0b45 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:31.084204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 997/1993] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:30 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:31.084204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce86ec3-4bc1-4bd3-9925-69f791a203ca admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:31.094738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b292-4616-4d46-837c-478be7aa0b45 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:31.149451 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce86ec3-4bc1-4bd3-9925-69f791a203ca admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:31.153983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009406a-39d2-4b70-a4c5-e4797bedb3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:31.154736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a59b7-5cc4-4c92-b63b-a6f24ad6d9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:31.154865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009406a-39d2-4b70-a4c5-e4797bedb3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:31.154995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009406a-39d2-4b70-a4c5-e4797bedb3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:31.155165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a59b7-5cc4-4c92-b63b-a6f24ad6d9ec admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:31.155276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009406a-39d2-4b70-a4c5-e4797bedb3d5 admin admin] PATH_INFO: `/v3/projects/20b511ad93fc41eb9a926472b3fe3ae4/users/9e23eaf509294f26bb2e6556d7751cc2/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:31.155454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a59b7-5cc4-4c92-b63b-a6f24ad6d9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:31.155733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a59b7-5cc4-4c92-b63b-a6f24ad6d9ec admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:31.156426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a59b7-5cc4-4c92-b63b-a6f24ad6d9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:31.158436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a59b7-5cc4-4c92-b63b-a6f24ad6d9ec admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:31.171323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009406a-39d2-4b70-a4c5-e4797bedb3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b511ad93fc41eb9a926472b3fe3ae4, user_id=9e23eaf509294f26bb2e6556d7751cc2, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:31.174116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009406a-39d2-4b70-a4c5-e4797bedb3d5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:31.178100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:31.313123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 998/1994] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:31 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:31.313123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a59b7-5cc4-4c92-b63b-a6f24ad6d9ec admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:31.321403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a59b7-5cc4-4c92-b63b-a6f24ad6d9ec admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:31.326076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44de9bf-5dc6-4003-8c42-74e41334bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:31.326663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44de9bf-5dc6-4003-8c42-74e41334bd68 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:31.326943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44de9bf-5dc6-4003-8c42-74e41334bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:31.327217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44de9bf-5dc6-4003-8c42-74e41334bd68 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:31.327868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44de9bf-5dc6-4003-8c42-74e41334bd68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:31.329826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44de9bf-5dc6-4003-8c42-74e41334bd68 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:31.384863 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 997/1995] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:31 2022] PUT /identity/v3/projects/20b511ad93fc41eb9a926472b3fe3ae4/users/9e23eaf509294f26bb2e6556d7751cc2/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:31.391676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009406a-39d2-4b70-a4c5-e4797bedb3d5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:31.464177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009406a-39d2-4b70-a4c5-e4797bedb3d5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:31.470779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31c074-2d25-4fbb-a55e-358c2d7c7113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:31.471520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31c074-2d25-4fbb-a55e-358c2d7c7113 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:31.471801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31c074-2d25-4fbb-a55e-358c2d7c7113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:31.472078 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31c074-2d25-4fbb-a55e-358c2d7c7113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:31.472947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31c074-2d25-4fbb-a55e-358c2d7c7113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:31.474593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31c074-2d25-4fbb-a55e-358c2d7c7113 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:31.486691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 998/1996] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:31.492799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1f030-81e1-4977-8416-cc9409aa63e8 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:31.492799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1f030-81e1-4977-8416-cc9409aa63e8 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:31.492799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1f030-81e1-4977-8416-cc9409aa63e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:31.523095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a7b1f030-81e1-4977-8416-cc9409aa63e8 None None] MFA Rules not processed for user `9e23eaf509294f26bb2e6556d7751cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:31.524333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a7b1f030-81e1-4977-8416-cc9409aa63e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:31.541252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 999/1997] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:31 2022] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:31.550472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44de9bf-5dc6-4003-8c42-74e41334bd68 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:31.560028 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44de9bf-5dc6-4003-8c42-74e41334bd68 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:31.566103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc094aaf-01a5-49ee-9d06-fc32a60b6587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:31.566904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc094aaf-01a5-49ee-9d06-fc32a60b6587 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:31.567558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc094aaf-01a5-49ee-9d06-fc32a60b6587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:31.568533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc094aaf-01a5-49ee-9d06-fc32a60b6587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:31.569351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc094aaf-01a5-49ee-9d06-fc32a60b6587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:31.572256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc094aaf-01a5-49ee-9d06-fc32a60b6587 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:31.590105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1000/1998] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:31.593999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc094aaf-01a5-49ee-9d06-fc32a60b6587 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:31.613486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc094aaf-01a5-49ee-9d06-fc32a60b6587 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:31.623539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814655a-61f3-4e2d-97e3-e7545262eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:31.634411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814655a-61f3-4e2d-97e3-e7545262eef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:31.634411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814655a-61f3-4e2d-97e3-e7545262eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:31.634411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814655a-61f3-4e2d-97e3-e7545262eef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:31.634411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814655a-61f3-4e2d-97e3-e7545262eef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:31.634411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814655a-61f3-4e2d-97e3-e7545262eef6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:31.652704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1001/1999] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:31.656629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814655a-61f3-4e2d-97e3-e7545262eef6 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:31.679166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 999/2000] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:31.680062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1f030-81e1-4977-8416-cc9409aa63e8 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:31.689521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814655a-61f3-4e2d-97e3-e7545262eef6 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:31.694489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a08c0-fb62-475c-abb6-4ca19035cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:31.695157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a08c0-fb62-475c-abb6-4ca19035cc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:31.695435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a08c0-fb62-475c-abb6-4ca19035cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:31.695709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a08c0-fb62-475c-abb6-4ca19035cc51 admin admin] PATH_INFO: `/v3/projects/c2a3de7f475943fbbc7927603f7d2d90/users/aefe45c440ff4a53abdbbd35908beddb/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:31.699276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1f030-81e1-4977-8416-cc9409aa63e8 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:31.704392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fc1f5-36b9-4f8a-945a-4c1eacfa8294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:31.704978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc1f5-36b9-4f8a-945a-4c1eacfa8294 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:31.705264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc1f5-36b9-4f8a-945a-4c1eacfa8294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:31.705542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc1f5-36b9-4f8a-945a-4c1eacfa8294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:31.706239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fc1f5-36b9-4f8a-945a-4c1eacfa8294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:31.707901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fc1f5-36b9-4f8a-945a-4c1eacfa8294 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:31.719090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1000/2001] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:31.719926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fc1f5-36b9-4f8a-945a-4c1eacfa8294 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:31.730640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fc1f5-36b9-4f8a-945a-4c1eacfa8294 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:31.732434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a08c0-fb62-475c-abb6-4ca19035cc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a3de7f475943fbbc7927603f7d2d90, user_id=aefe45c440ff4a53abdbbd35908beddb, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:31.735232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a08c0-fb62-475c-abb6-4ca19035cc51 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:31.742652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a8446-20aa-4e35-9ced-281510f5957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:31.743504 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a8446-20aa-4e35-9ced-281510f5957a admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:31.743842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a8446-20aa-4e35-9ced-281510f5957a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:31.744122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a8446-20aa-4e35-9ced-281510f5957a admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:31.744813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a8446-20aa-4e35-9ced-281510f5957a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:31.747751 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a8446-20aa-4e35-9ced-281510f5957a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:31.934128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1002/2002] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:31 2022] PUT /identity/v3/projects/c2a3de7f475943fbbc7927603f7d2d90/users/aefe45c440ff4a53abdbbd35908beddb/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:31.941707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a08c0-fb62-475c-abb6-4ca19035cc51 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:31.941831 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1001/2003] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:31 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:31.943160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a8446-20aa-4e35-9ced-281510f5957a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:32.003794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a08c0-fb62-475c-abb6-4ca19035cc51 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:32.019490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a8446-20aa-4e35-9ced-281510f5957a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:32.024742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d950ba-9838-471f-b478-b889d5837f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:32.025351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d950ba-9838-471f-b478-b889d5837f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.025786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d950ba-9838-471f-b478-b889d5837f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.026099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d950ba-9838-471f-b478-b889d5837f98 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.026738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d950ba-9838-471f-b478-b889d5837f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:32.028827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d950ba-9838-471f-b478-b889d5837f98 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:32.061645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49230261-f310-47a2-96e4-1d35b9558b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:32.062343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49230261-f310-47a2-96e4-1d35b9558b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.062642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49230261-f310-47a2-96e4-1d35b9558b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.062919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49230261-f310-47a2-96e4-1d35b9558b6a admin admin] PATH_INFO: `/v3/projects/d57c9acf41df47599a4b9b3f655ea6ab/users/4c82efd9e39f4cf78f3e3a3de1e8bd29/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.078528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49230261-f310-47a2-96e4-1d35b9558b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57c9acf41df47599a4b9b3f655ea6ab, user_id=4c82efd9e39f4cf78f3e3a3de1e8bd29, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:32.081597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49230261-f310-47a2-96e4-1d35b9558b6a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:32.144095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1002/2004] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:31 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:32.145369 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcbe92-595b-49f0-942d-05aa757ebcfa None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.145793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcbe92-595b-49f0-942d-05aa757ebcfa None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.146678 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcbe92-595b-49f0-942d-05aa757ebcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.178892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-46bcbe92-595b-49f0-942d-05aa757ebcfa None None] MFA Rules not processed for user `aefe45c440ff4a53abdbbd35908beddb`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:32.180233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-46bcbe92-595b-49f0-942d-05aa757ebcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:32.192993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1003/2005] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:31 2022] PUT /identity/v3/projects/d57c9acf41df47599a4b9b3f655ea6ab/users/4c82efd9e39f4cf78f3e3a3de1e8bd29/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:32.193303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49230261-f310-47a2-96e4-1d35b9558b6a admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:32.266998 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1003/2006] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:32.268050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84747b57-c583-4072-9bd2-e7ee3b620cdc None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.268339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84747b57-c583-4072-9bd2-e7ee3b620cdc None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.268620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84747b57-c583-4072-9bd2-e7ee3b620cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.273567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49230261-f310-47a2-96e4-1d35b9558b6a admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:32.280444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e664ed-4ec2-45ae-8ae9-5d1563db4cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:32.281071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e664ed-4ec2-45ae-8ae9-5d1563db4cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.281354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e664ed-4ec2-45ae-8ae9-5d1563db4cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.281633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e664ed-4ec2-45ae-8ae9-5d1563db4cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.282514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e664ed-4ec2-45ae-8ae9-5d1563db4cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:32.284626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e664ed-4ec2-45ae-8ae9-5d1563db4cf6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:32.296157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1004/2007] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:32.298630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e664ed-4ec2-45ae-8ae9-5d1563db4cf6 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:32.299683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-84747b57-c583-4072-9bd2-e7ee3b620cdc None None] MFA Rules not processed for user `4c82efd9e39f4cf78f3e3a3de1e8bd29`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:32.300845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a4e664ed-4ec2-45ae-8ae9-5d1563db4cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:32.301333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-84747b57-c583-4072-9bd2-e7ee3b620cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:32.368872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e664ed-4ec2-45ae-8ae9-5d1563db4cf6 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:32.372845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319c32d-5902-45c5-82b8-f1908dd5e15d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:32.373659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319c32d-5902-45c5-82b8-f1908dd5e15d service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.373902 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319c32d-5902-45c5-82b8-f1908dd5e15d service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.374170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319c32d-5902-45c5-82b8-f1908dd5e15d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.377724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1004/2008] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:32.378546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84747b57-c583-4072-9bd2-e7ee3b620cdc None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:32.395761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84747b57-c583-4072-9bd2-e7ee3b620cdc None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:32.403597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fca353-6e26-4dbb-b045-591b2275c7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:32.404801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fca353-6e26-4dbb-b045-591b2275c7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.409136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fca353-6e26-4dbb-b045-591b2275c7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.409136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fca353-6e26-4dbb-b045-591b2275c7cc admin admin] PATH_INFO: `/v3/projects/cb709b87e93644dc9b2ff2c872889aa6/users/00410ea7b05e487b9782563c5aea677f/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.431092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fca353-6e26-4dbb-b045-591b2275c7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb709b87e93644dc9b2ff2c872889aa6, user_id=00410ea7b05e487b9782563c5aea677f, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:32.436953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fca353-6e26-4dbb-b045-591b2275c7cc admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:32.457806 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319c32d-5902-45c5-82b8-f1908dd5e15d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:32.460168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319c32d-5902-45c5-82b8-f1908dd5e15d service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:32.476610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1005/2009] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:32.477858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319c32d-5902-45c5-82b8-f1908dd5e15d service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:32.501167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319c32d-5902-45c5-82b8-f1908dd5e15d service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:32.508214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5aac0-c9c6-4635-bf11-0b8b8df10b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:32.508857 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5aac0-c9c6-4635-bf11-0b8b8df10b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.509248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5aac0-c9c6-4635-bf11-0b8b8df10b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.509422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5aac0-c9c6-4635-bf11-0b8b8df10b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.510572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5aac0-c9c6-4635-bf11-0b8b8df10b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:32.513426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5aac0-c9c6-4635-bf11-0b8b8df10b7f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:32.707335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1005/2010] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:32 2022] PUT /identity/v3/projects/cb709b87e93644dc9b2ff2c872889aa6/users/00410ea7b05e487b9782563c5aea677f/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:32.707335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fca353-6e26-4dbb-b045-591b2275c7cc admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:32.771084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1006/2011] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:32 2022] POST /identity/v3/projects => generated 373 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:32.772236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5aac0-c9c6-4635-bf11-0b8b8df10b7f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:32.829052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:32.889037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5aac0-c9c6-4635-bf11-0b8b8df10b7f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:32.893339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fca353-6e26-4dbb-b045-591b2275c7cc admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:32.904381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99ae71-5d5f-4986-a639-f7fe7d16956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:32.905189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99ae71-5d5f-4986-a639-f7fe7d16956b admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.905605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99ae71-5d5f-4986-a639-f7fe7d16956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.906062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99ae71-5d5f-4986-a639-f7fe7d16956b admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.906855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99ae71-5d5f-4986-a639-f7fe7d16956b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:32.908703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99ae71-5d5f-4986-a639-f7fe7d16956b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:32.915078 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:32.915847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.916225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.916575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] PATH_INFO: `/v3/users/aefe45c440ff4a53abdbbd35908beddb` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.918004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=aefe45c440ff4a53abdbbd35908beddb)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:32.920063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:32.924627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1007/2012] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:32.926006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99ae71-5d5f-4986-a639-f7fe7d16956b admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:32.939826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99ae71-5d5f-4986-a639-f7fe7d16956b admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:32.946216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc985ae-927d-4f2f-81a6-87b79f0a1a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:32.946833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc985ae-927d-4f2f-81a6-87b79f0a1a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:32.947118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc985ae-927d-4f2f-81a6-87b79f0a1a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:32.947391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc985ae-927d-4f2f-81a6-87b79f0a1a64 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:32.948085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc985ae-927d-4f2f-81a6-87b79f0a1a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:32.950066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc985ae-927d-4f2f-81a6-87b79f0a1a64 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:33.273953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1008/2013] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:32 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:33.274773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc985ae-927d-4f2f-81a6-87b79f0a1a64 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:33.285209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc985ae-927d-4f2f-81a6-87b79f0a1a64 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:33.285383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aefe45c440ff4a53abdbbd35908beddb'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:33.290890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002829c-260d-4c96-841d-964b100d4ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:33.291865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002829c-260d-4c96-841d-964b100d4ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.292146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002829c-260d-4c96-841d-964b100d4ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.292428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002829c-260d-4c96-841d-964b100d4ca9 admin admin] PATH_INFO: `/v3/projects/cb709b87e93644dc9b2ff2c872889aa6/users/00410ea7b05e487b9782563c5aea677f/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.294374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002829c-260d-4c96-841d-964b100d4ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb709b87e93644dc9b2ff2c872889aa6, user_id=00410ea7b05e487b9782563c5aea677f, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:33.297049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002829c-260d-4c96-841d-964b100d4ca9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:33.309020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1009/2014] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:33 2022] PUT /identity/v3/projects/cb709b87e93644dc9b2ff2c872889aa6/users/00410ea7b05e487b9782563c5aea677f/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:33.309886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002829c-260d-4c96-841d-964b100d4ca9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:33.380299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aefe45c440ff4a53abdbbd35908beddb'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:33.380942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aefe45c440ff4a53abdbbd35908beddb'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:33.383231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002829c-260d-4c96-841d-964b100d4ca9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:33.387921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9341f92-e6fa-43e5-8944-a2f6427ef031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:33.388538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341f92-e6fa-43e5-8944-a2f6427ef031 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.388809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341f92-e6fa-43e5-8944-a2f6427ef031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.389080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341f92-e6fa-43e5-8944-a2f6427ef031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.389772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9341f92-e6fa-43e5-8944-a2f6427ef031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:33.391442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9341f92-e6fa-43e5-8944-a2f6427ef031 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:33.395024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aefe45c440ff4a53abdbbd35908beddb'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:33.395889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aefe45c440ff4a53abdbbd35908beddb'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:33.401379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1010/2015] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:33.401379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee1b02-5ad2-4e00-be34-d7797438623e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.401379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee1b02-5ad2-4e00-be34-d7797438623e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.401379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee1b02-5ad2-4e00-be34-d7797438623e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.414692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1006/2016] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:32 2022] DELETE /identity/v3/users/aefe45c440ff4a53abdbbd35908beddb => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:33.418171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:33.418171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:33.440418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-a5ee1b02-5ad2-4e00-be34-d7797438623e None None] MFA Rules not processed for user `00410ea7b05e487b9782563c5aea677f`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:33.441817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a5ee1b02-5ad2-4e00-be34-d7797438623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:33.488423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a593339-656d-4a41-85f8-d9d5be39e4fd admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:33.493596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9483e2a-5ea3-46a9-b375-f27c8d8c845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:33.494377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9483e2a-5ea3-46a9-b375-f27c8d8c845d admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.494672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9483e2a-5ea3-46a9-b375-f27c8d8c845d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.494978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9483e2a-5ea3-46a9-b375-f27c8d8c845d admin admin] PATH_INFO: `/v3/projects/e327f7e2e3c642b99f4c6a38e6ecbf96/users/a36293418a8a45bda7f39252425d4d56/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.514646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9483e2a-5ea3-46a9-b375-f27c8d8c845d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e327f7e2e3c642b99f4c6a38e6ecbf96, user_id=a36293418a8a45bda7f39252425d4d56, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:33.518673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9483e2a-5ea3-46a9-b375-f27c8d8c845d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:33.526470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1011/2017] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:33.526470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42bc41-14cc-40f5-aa48-5882e9a4d704 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.526470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42bc41-14cc-40f5-aa48-5882e9a4d704 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.526470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42bc41-14cc-40f5-aa48-5882e9a4d704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.545804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-2d42bc41-14cc-40f5-aa48-5882e9a4d704 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:33.547105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2d42bc41-14cc-40f5-aa48-5882e9a4d704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:33.555097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1012/2018] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:33.556573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42bc41-14cc-40f5-aa48-5882e9a4d704 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:33.558795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2d42bc41-14cc-40f5-aa48-5882e9a4d704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:33.622418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42bc41-14cc-40f5-aa48-5882e9a4d704 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:33.626153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3011aef-7cc0-407e-97d0-b46bdf1b07c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:33.626821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3011aef-7cc0-407e-97d0-b46bdf1b07c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.627116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3011aef-7cc0-407e-97d0-b46bdf1b07c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.627400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3011aef-7cc0-407e-97d0-b46bdf1b07c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.637310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3011aef-7cc0-407e-97d0-b46bdf1b07c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:33.638797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3011aef-7cc0-407e-97d0-b46bdf1b07c3 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:33.650522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1013/2019] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:33.651821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3011aef-7cc0-407e-97d0-b46bdf1b07c3 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:33.653471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d3011aef-7cc0-407e-97d0-b46bdf1b07c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:33.656029 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1007/2020] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:33 2022] PUT /identity/v3/projects/e327f7e2e3c642b99f4c6a38e6ecbf96/users/a36293418a8a45bda7f39252425d4d56/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:33.657259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9483e2a-5ea3-46a9-b375-f27c8d8c845d admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:33.723713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9483e2a-5ea3-46a9-b375-f27c8d8c845d admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:33.731508 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20592ae-e3e6-4714-af93-5c7263a6f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:33.735994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3011aef-7cc0-407e-97d0-b46bdf1b07c3 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:33.743762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20592ae-e3e6-4714-af93-5c7263a6f3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.743762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20592ae-e3e6-4714-af93-5c7263a6f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.743762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20592ae-e3e6-4714-af93-5c7263a6f3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.744171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20592ae-e3e6-4714-af93-5c7263a6f3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:33.745843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20592ae-e3e6-4714-af93-5c7263a6f3fb admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:33.759218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1008/2021] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:33.764009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20592ae-e3e6-4714-af93-5c7263a6f3fb admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:33.775648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20592ae-e3e6-4714-af93-5c7263a6f3fb admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:33.781769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc67a40-3851-4666-aeab-1fb65c80e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:33.782439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67a40-3851-4666-aeab-1fb65c80e3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.782729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67a40-3851-4666-aeab-1fb65c80e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.783469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67a40-3851-4666-aeab-1fb65c80e3a9 admin admin] PATH_INFO: `/v3/projects/e327f7e2e3c642b99f4c6a38e6ecbf96/users/a36293418a8a45bda7f39252425d4d56/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.785809 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc67a40-3851-4666-aeab-1fb65c80e3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e327f7e2e3c642b99f4c6a38e6ecbf96, user_id=a36293418a8a45bda7f39252425d4d56, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:33.788739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc67a40-3851-4666-aeab-1fb65c80e3a9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:33.805774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1009/2022] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:33 2022] PUT /identity/v3/projects/e327f7e2e3c642b99f4c6a38e6ecbf96/users/a36293418a8a45bda7f39252425d4d56/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:33.813048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433df7e-14cc-428c-95c8-fcc50a4df6c2 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.813331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433df7e-14cc-428c-95c8-fcc50a4df6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.822273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433df7e-14cc-428c-95c8-fcc50a4df6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.822400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7474ba-601a-4d9f-958a-b7f87b72e87a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:33.822400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7474ba-601a-4d9f-958a-b7f87b72e87a service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:33.822400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7474ba-601a-4d9f-958a-b7f87b72e87a service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:33.822400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7474ba-601a-4d9f-958a-b7f87b72e87a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:33.834934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7474ba-601a-4d9f-958a-b7f87b72e87a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:33.836560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7474ba-601a-4d9f-958a-b7f87b72e87a service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:33.866103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1014/2023] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:33.870302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b433df7e-14cc-428c-95c8-fcc50a4df6c2 None None] MFA Rules not processed for user `a36293418a8a45bda7f39252425d4d56`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:33.872849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b433df7e-14cc-428c-95c8-fcc50a4df6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:33.902997 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7474ba-601a-4d9f-958a-b7f87b72e87a service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:33.907099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cc7474ba-601a-4d9f-958a-b7f87b72e87a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:33.991510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1010/2024] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:34.040272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7474ba-601a-4d9f-958a-b7f87b72e87a service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:34.112028 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceabcfc-ee09-41bd-a304-4bc1d2d9b3d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:34.113188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceabcfc-ee09-41bd-a304-4bc1d2d9b3d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:34.113564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceabcfc-ee09-41bd-a304-4bc1d2d9b3d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:34.114327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceabcfc-ee09-41bd-a304-4bc1d2d9b3d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:34.119072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-bceabcfc-ee09-41bd-a304-4bc1d2d9b3d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:34.237414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceabcfc-ee09-41bd-a304-4bc1d2d9b3d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:34.237414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceabcfc-ee09-41bd-a304-4bc1d2d9b3d4 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:34.237414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1015/2025] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:34.342281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433df7e-14cc-428c-95c8-fcc50a4df6c2 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:34.356999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433df7e-14cc-428c-95c8-fcc50a4df6c2 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:34.373577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a3140-a884-44e0-b5dc-d08c4b443a6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:34.374202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a3140-a884-44e0-b5dc-d08c4b443a6a service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:34.374490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a3140-a884-44e0-b5dc-d08c4b443a6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:34.374808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a3140-a884-44e0-b5dc-d08c4b443a6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:34.379727 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7b8a3140-a884-44e0-b5dc-d08c4b443a6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:34.451068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a3140-a884-44e0-b5dc-d08c4b443a6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:34.452833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a3140-a884-44e0-b5dc-d08c4b443a6a service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:34.463610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1011/2026] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:34.490419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:34.580274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceabcfc-ee09-41bd-a304-4bc1d2d9b3d4 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:34.581726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-bceabcfc-ee09-41bd-a304-4bc1d2d9b3d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:34.669096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceabcfc-ee09-41bd-a304-4bc1d2d9b3d4 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:34.674213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:34.674890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:34.675325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:34.675609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] PATH_INFO: `/v3/projects/c2a3de7f475943fbbc7927603f7d2d90` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:34.676734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a3de7f475943fbbc7927603f7d2d90)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:34.679464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:34.840956 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a3de7f475943fbbc7927603f7d2d90', 'request_id': 'req-ae415655-bbce-4903-b77c-a617f9df8a18'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:34.850360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a3de7f475943fbbc7927603f7d2d90', 'request_id': 'req-ae415655-bbce-4903-b77c-a617f9df8a18'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:34.972169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a3de7f475943fbbc7927603f7d2d90', 'request_id': 'req-ae415655-bbce-4903-b77c-a617f9df8a18'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:34.987580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] The token cache is being invalidate because project c2a3de7f475943fbbc7927603f7d2d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:34.987874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:34.988588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae415655-bbce-4903-b77c-a617f9df8a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:34.991140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1016/2027] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:34 2022] DELETE /identity/v3/projects/c2a3de7f475943fbbc7927603f7d2d90 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:34.995539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d7e46-ea07-49da-a80c-ea46a0f21292 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:34.996186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d7e46-ea07-49da-a80c-ea46a0f21292 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:34.996186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d7e46-ea07-49da-a80c-ea46a0f21292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:35.035762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-154d7e46-ea07-49da-a80c-ea46a0f21292 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:35.042734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-154d7e46-ea07-49da-a80c-ea46a0f21292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:35.117458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1012/2028] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:35.126290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3992e-e122-4778-9e9d-2f3b5feb620b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:35.126834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3992e-e122-4778-9e9d-2f3b5feb620b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:35.126978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3992e-e122-4778-9e9d-2f3b5feb620b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:35.159277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e6e3992e-e122-4778-9e9d-2f3b5feb620b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:35.159277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e6e3992e-e122-4778-9e9d-2f3b5feb620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:35.171443 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d7e46-ea07-49da-a80c-ea46a0f21292 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:35.182169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1017/2029] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:35.183076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d7e46-ea07-49da-a80c-ea46a0f21292 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:35.197169 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb375d-1c4d-481d-b101-15a5dfff02f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:35.198091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb375d-1c4d-481d-b101-15a5dfff02f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:35.198528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb375d-1c4d-481d-b101-15a5dfff02f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:35.198954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb375d-1c4d-481d-b101-15a5dfff02f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:35.199973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb375d-1c4d-481d-b101-15a5dfff02f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:35.200436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb375d-1c4d-481d-b101-15a5dfff02f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:35.202319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb375d-1c4d-481d-b101-15a5dfff02f7 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:35.219711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1013/2030] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:35.227845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3992e-e122-4778-9e9d-2f3b5feb620b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:35.240284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3992e-e122-4778-9e9d-2f3b5feb620b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:35.250404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ae0ec-6b1f-4446-8539-5ac45ae34ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:35.251170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ae0ec-6b1f-4446-8539-5ac45ae34ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:35.251594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ae0ec-6b1f-4446-8539-5ac45ae34ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:35.251966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ae0ec-6b1f-4446-8539-5ac45ae34ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:35.252708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ae0ec-6b1f-4446-8539-5ac45ae34ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:35.255005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ae0ec-6b1f-4446-8539-5ac45ae34ca9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:35.444533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1018/2031] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:35 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:35.448697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb375d-1c4d-481d-b101-15a5dfff02f7 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:35.459068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb375d-1c4d-481d-b101-15a5dfff02f7 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:35.596543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2cc8-f9e5-4999-a711-6b05b0114bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:35.597071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2cc8-f9e5-4999-a711-6b05b0114bea admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:35.597359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2cc8-f9e5-4999-a711-6b05b0114bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:35.597640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2cc8-f9e5-4999-a711-6b05b0114bea admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:35.598333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a2cc8-f9e5-4999-a711-6b05b0114bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:35.603762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a2cc8-f9e5-4999-a711-6b05b0114bea admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:35.731781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ae0ec-6b1f-4446-8539-5ac45ae34ca9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:35.733496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-db7ae0ec-6b1f-4446-8539-5ac45ae34ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:35.744133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:35.747674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1014/2032] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:35 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:35.748441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ae0ec-6b1f-4446-8539-5ac45ae34ca9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:35.751674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2cc8-f9e5-4999-a711-6b05b0114bea admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:35.753369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:35.754035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:35.754319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:35.754594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] PATH_INFO: `/v3/users/9e23eaf509294f26bb2e6556d7751cc2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:35.756437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e23eaf509294f26bb2e6556d7751cc2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:35.758403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:35.762458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2cc8-f9e5-4999-a711-6b05b0114bea admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:35.767129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90939f-93c7-4ee2-9e7a-e3edb692d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:35.767822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90939f-93c7-4ee2-9e7a-e3edb692d166 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:35.768166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90939f-93c7-4ee2-9e7a-e3edb692d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:35.768528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90939f-93c7-4ee2-9e7a-e3edb692d166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:35.769243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90939f-93c7-4ee2-9e7a-e3edb692d166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:35.771144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90939f-93c7-4ee2-9e7a-e3edb692d166 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:35.782093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1015/2033] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:35.788460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90939f-93c7-4ee2-9e7a-e3edb692d166 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:35.797974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90939f-93c7-4ee2-9e7a-e3edb692d166 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:35.803095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a3d15-e14f-4910-ba63-074b221242ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:35.803672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a3d15-e14f-4910-ba63-074b221242ef admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:35.803960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a3d15-e14f-4910-ba63-074b221242ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:35.804234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a3d15-e14f-4910-ba63-074b221242ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:35.804870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a3d15-e14f-4910-ba63-074b221242ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:35.806471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a3d15-e14f-4910-ba63-074b221242ef admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:35.816480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1016/2034] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:35.821086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a3d15-e14f-4910-ba63-074b221242ef admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:35.831126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a3d15-e14f-4910-ba63-074b221242ef admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:35.836051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0075bc4-6987-4c02-b15d-229b8b8db75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:35.836657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0075bc4-6987-4c02-b15d-229b8b8db75f admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:35.836936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0075bc4-6987-4c02-b15d-229b8b8db75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:35.837208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0075bc4-6987-4c02-b15d-229b8b8db75f admin admin] PATH_INFO: `/v3/projects/b087134bda4c449dbd1d85929a288594/users/d047dc004f924855a58f0b00e26b8cec/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:35.860211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0075bc4-6987-4c02-b15d-229b8b8db75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b087134bda4c449dbd1d85929a288594, user_id=d047dc004f924855a58f0b00e26b8cec, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:35.860211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0075bc4-6987-4c02-b15d-229b8b8db75f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:35.957833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1017/2035] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:35 2022] PUT /identity/v3/projects/b087134bda4c449dbd1d85929a288594/users/d047dc004f924855a58f0b00e26b8cec/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:35.981042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570fda9-26f2-46b5-8718-c1f196673f69 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:35.981328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570fda9-26f2-46b5-8718-c1f196673f69 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:35.981606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570fda9-26f2-46b5-8718-c1f196673f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:36.011235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-0570fda9-26f2-46b5-8718-c1f196673f69 None None] MFA Rules not processed for user `d047dc004f924855a58f0b00e26b8cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:36.012465 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0570fda9-26f2-46b5-8718-c1f196673f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:36.063725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e23eaf509294f26bb2e6556d7751cc2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:36.064544 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e23eaf509294f26bb2e6556d7751cc2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:36.065262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e23eaf509294f26bb2e6556d7751cc2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:36.078730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1018/2036] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:36.083563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570fda9-26f2-46b5-8718-c1f196673f69 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:36.144013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570fda9-26f2-46b5-8718-c1f196673f69 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:36.148481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4efa6f-8839-4ee3-83a1-b689c52969c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:36.149093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4efa6f-8839-4ee3-83a1-b689c52969c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:36.149374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4efa6f-8839-4ee3-83a1-b689c52969c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:36.149648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4efa6f-8839-4ee3-83a1-b689c52969c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:36.150308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4efa6f-8839-4ee3-83a1-b689c52969c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:36.152281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4efa6f-8839-4ee3-83a1-b689c52969c6 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:36.172494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e23eaf509294f26bb2e6556d7751cc2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:36.186363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4070621b-7ee7-48d7-a652-7595c3ae8bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e23eaf509294f26bb2e6556d7751cc2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:36.198328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1019/2037] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:35 2022] DELETE /identity/v3/users/9e23eaf509294f26bb2e6556d7751cc2 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:36.202938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424b500-5142-4db7-83a1-b0731abd93c2 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:36.203264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424b500-5142-4db7-83a1-b0731abd93c2 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:36.203544 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424b500-5142-4db7-83a1-b0731abd93c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:36.224589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-d424b500-5142-4db7-83a1-b0731abd93c2 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:36.226690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d424b500-5142-4db7-83a1-b0731abd93c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:36.276571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1019/2038] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:36 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:36.277805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4efa6f-8839-4ee3-83a1-b689c52969c6 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:36.279817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3e4efa6f-8839-4ee3-83a1-b689c52969c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:36.290763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1020/2039] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:36.300659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424b500-5142-4db7-83a1-b0731abd93c2 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:36.302047 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d424b500-5142-4db7-83a1-b0731abd93c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:36.348211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4efa6f-8839-4ee3-83a1-b689c52969c6 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:36.353773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dde6a8-ccd7-4010-984f-ddde798fb7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:36.354631 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dde6a8-ccd7-4010-984f-ddde798fb7ab admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:36.354952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dde6a8-ccd7-4010-984f-ddde798fb7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:36.355228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dde6a8-ccd7-4010-984f-ddde798fb7ab admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:36.355873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dde6a8-ccd7-4010-984f-ddde798fb7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:36.357818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dde6a8-ccd7-4010-984f-ddde798fb7ab admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:36.360851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424b500-5142-4db7-83a1-b0731abd93c2 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:36.408458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40a181-6fc5-4769-bc12-fb1eb0005fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:36.408999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40a181-6fc5-4769-bc12-fb1eb0005fee service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:36.409268 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40a181-6fc5-4769-bc12-fb1eb0005fee service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:36.410025 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40a181-6fc5-4769-bc12-fb1eb0005fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:36.419447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40a181-6fc5-4769-bc12-fb1eb0005fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:36.420880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40a181-6fc5-4769-bc12-fb1eb0005fee service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:36.431328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1021/2040] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:36.530167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1020/2041] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:36 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:36.534350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40a181-6fc5-4769-bc12-fb1eb0005fee service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:36.545067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40a181-6fc5-4769-bc12-fb1eb0005fee service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:36.549907 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9aad-daf9-4685-96dc-c9ec86661225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:36.550522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9aad-daf9-4685-96dc-c9ec86661225 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:36.550803 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9aad-daf9-4685-96dc-c9ec86661225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:36.551076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b9aad-daf9-4685-96dc-c9ec86661225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:36.551730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b9aad-daf9-4685-96dc-c9ec86661225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:36.553392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b9aad-daf9-4685-96dc-c9ec86661225 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:36.564121 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1022/2042] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:36.572663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dde6a8-ccd7-4010-984f-ddde798fb7ab admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:36.584270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dde6a8-ccd7-4010-984f-ddde798fb7ab admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:36.589644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0818c-b853-44fc-a3c4-3b0f7171047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:36.590309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0818c-b853-44fc-a3c4-3b0f7171047b admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:36.590579 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0818c-b853-44fc-a3c4-3b0f7171047b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:36.590865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0818c-b853-44fc-a3c4-3b0f7171047b admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:36.591799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0818c-b853-44fc-a3c4-3b0f7171047b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:36.593658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0818c-b853-44fc-a3c4-3b0f7171047b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:36.605638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1021/2043] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:36.610117 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9aad-daf9-4685-96dc-c9ec86661225 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:36.621279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b9aad-daf9-4685-96dc-c9ec86661225 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:36.626031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d876d-7232-4383-8e88-f62b6453fbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:36.626787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d876d-7232-4383-8e88-f62b6453fbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:36.627133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d876d-7232-4383-8e88-f62b6453fbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:36.627479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d876d-7232-4383-8e88-f62b6453fbd8 admin admin] PATH_INFO: `/v3/projects/dbcfa7803ce446ffa4669d1b37833f19/users/1a851140f9504c0a9dde6aa1126e5b43/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:36.644020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d876d-7232-4383-8e88-f62b6453fbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcfa7803ce446ffa4669d1b37833f19, user_id=1a851140f9504c0a9dde6aa1126e5b43, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:36.647333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d876d-7232-4383-8e88-f62b6453fbd8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:37.008135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1023/2044] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:36 2022] PUT /identity/v3/projects/dbcfa7803ce446ffa4669d1b37833f19/users/1a851140f9504c0a9dde6aa1126e5b43/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:37.021924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a96303-e4b1-4086-806b-7053cf7255a3 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:37.021924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a96303-e4b1-4086-806b-7053cf7255a3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:37.021924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a96303-e4b1-4086-806b-7053cf7255a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:37.059768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-15a96303-e4b1-4086-806b-7053cf7255a3 None None] MFA Rules not processed for user `1a851140f9504c0a9dde6aa1126e5b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:37.059768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-15a96303-e4b1-4086-806b-7053cf7255a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:37.105970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d876d-7232-4383-8e88-f62b6453fbd8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:37.105970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b63d876d-7232-4383-8e88-f62b6453fbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:37.156831 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1022/2045] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:37.161318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a96303-e4b1-4086-806b-7053cf7255a3 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:37.196206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d876d-7232-4383-8e88-f62b6453fbd8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:37.201596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:37.202299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:37.202583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:37.202862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] PATH_INFO: `/v3/projects/20b511ad93fc41eb9a926472b3fe3ae4` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:37.204119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b511ad93fc41eb9a926472b3fe3ae4)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:37.206126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:37.244833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a96303-e4b1-4086-806b-7053cf7255a3 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:37.250144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13ba57-7bdc-4d01-b052-924e0b38114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:37.250938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13ba57-7bdc-4d01-b052-924e0b38114b admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:37.251408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13ba57-7bdc-4d01-b052-924e0b38114b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:37.251749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13ba57-7bdc-4d01-b052-924e0b38114b admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:37.252542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13ba57-7bdc-4d01-b052-924e0b38114b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:37.255162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13ba57-7bdc-4d01-b052-924e0b38114b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:37.377002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b511ad93fc41eb9a926472b3fe3ae4', 'request_id': 'req-bccb0022-5e47-428d-9069-e3ad5afe9f33'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:37.384699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b511ad93fc41eb9a926472b3fe3ae4', 'request_id': 'req-bccb0022-5e47-428d-9069-e3ad5afe9f33'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:37.420834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1023/2046] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:37 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:37.420834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13ba57-7bdc-4d01-b052-924e0b38114b admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:37.492859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13ba57-7bdc-4d01-b052-924e0b38114b admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:37.498119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318410f0-e7b1-41eb-98bd-63ef9ba0516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:37.498739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318410f0-e7b1-41eb-98bd-63ef9ba0516a admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:37.499299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318410f0-e7b1-41eb-98bd-63ef9ba0516a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:37.499655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318410f0-e7b1-41eb-98bd-63ef9ba0516a admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:37.500374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318410f0-e7b1-41eb-98bd-63ef9ba0516a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:37.503740 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b511ad93fc41eb9a926472b3fe3ae4', 'request_id': 'req-bccb0022-5e47-428d-9069-e3ad5afe9f33'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:37.504092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318410f0-e7b1-41eb-98bd-63ef9ba0516a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:37.517778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] The token cache is being invalidate because project 20b511ad93fc41eb9a926472b3fe3ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:37.518224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:37.518950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:37.520698 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1024/2047] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:37 2022] DELETE /identity/v3/projects/20b511ad93fc41eb9a926472b3fe3ae4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:37.525117 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:37.527327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:37.610624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0022-5e47-428d-9069-e3ad5afe9f33 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:37.622982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:37.623784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:37.624089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:37.624371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] PATH_INFO: `/v3/users/00410ea7b05e487b9782563c5aea677f` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:37.626544 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00410ea7b05e487b9782563c5aea677f)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:37.629070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:37.654100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1024/2048] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:37 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:37.660974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318410f0-e7b1-41eb-98bd-63ef9ba0516a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:37.664118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-318410f0-e7b1-41eb-98bd-63ef9ba0516a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:37.685603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318410f0-e7b1-41eb-98bd-63ef9ba0516a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:37.690780 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9e7e6-dc77-4fb9-aaba-fdbf9677872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:37.691431 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e7e6-dc77-4fb9-aaba-fdbf9677872a admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:37.691718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e7e6-dc77-4fb9-aaba-fdbf9677872a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:37.692719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e7e6-dc77-4fb9-aaba-fdbf9677872a admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:37.692916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9e7e6-dc77-4fb9-aaba-fdbf9677872a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:37.694799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9e7e6-dc77-4fb9-aaba-fdbf9677872a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:37.705962 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1025/2049] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:37.714715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9e7e6-dc77-4fb9-aaba-fdbf9677872a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:37.727852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9e7e6-dc77-4fb9-aaba-fdbf9677872a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:37.734216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3339a-d780-4b5b-9d28-39aeb0153aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:37.734829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3339a-d780-4b5b-9d28-39aeb0153aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:37.736175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3339a-d780-4b5b-9d28-39aeb0153aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:37.736175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3339a-d780-4b5b-9d28-39aeb0153aeb admin admin] PATH_INFO: `/v3/projects/716c7abebe8b4a02a75ba0acfc87a31c/users/ada62513bec54142b14b79afadc04dc2/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:37.765807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3339a-d780-4b5b-9d28-39aeb0153aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=716c7abebe8b4a02a75ba0acfc87a31c, user_id=ada62513bec54142b14b79afadc04dc2, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:37.769433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3339a-d780-4b5b-9d28-39aeb0153aeb admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:38.019496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1026/2050] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:37 2022] PUT /identity/v3/projects/716c7abebe8b4a02a75ba0acfc87a31c/users/ada62513bec54142b14b79afadc04dc2/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:38.024387 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3339a-d780-4b5b-9d28-39aeb0153aeb admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:38.081411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00410ea7b05e487b9782563c5aea677f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:38.081411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00410ea7b05e487b9782563c5aea677f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:38.081411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00410ea7b05e487b9782563c5aea677f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:38.114443 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3339a-d780-4b5b-9d28-39aeb0153aeb admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:38.119815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744aea7-b5b0-48c2-bc12-7d312837c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:38.120463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744aea7-b5b0-48c2-bc12-7d312837c947 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:38.120743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744aea7-b5b0-48c2-bc12-7d312837c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:38.121034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744aea7-b5b0-48c2-bc12-7d312837c947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:38.122038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744aea7-b5b0-48c2-bc12-7d312837c947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:38.123877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744aea7-b5b0-48c2-bc12-7d312837c947 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:38.136744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1027/2051] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:38.140968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744aea7-b5b0-48c2-bc12-7d312837c947 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:38.142695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d744aea7-b5b0-48c2-bc12-7d312837c947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:38.156505 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744aea7-b5b0-48c2-bc12-7d312837c947 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:38.162540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89771e4d-d30b-4282-ad99-2c406deddd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:38.163217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89771e4d-d30b-4282-ad99-2c406deddd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:38.163499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89771e4d-d30b-4282-ad99-2c406deddd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:38.163773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89771e4d-d30b-4282-ad99-2c406deddd7d admin admin] PATH_INFO: `/v3/projects/716c7abebe8b4a02a75ba0acfc87a31c/users/ada62513bec54142b14b79afadc04dc2/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:38.167841 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89771e4d-d30b-4282-ad99-2c406deddd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=716c7abebe8b4a02a75ba0acfc87a31c, user_id=ada62513bec54142b14b79afadc04dc2, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:38.168779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89771e4d-d30b-4282-ad99-2c406deddd7d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:38.181383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1028/2052] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:38 2022] PUT /identity/v3/projects/716c7abebe8b4a02a75ba0acfc87a31c/users/ada62513bec54142b14b79afadc04dc2/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:38.193643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907ff87-4b56-4a58-844b-fb344c5c34bf None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:38.193991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907ff87-4b56-4a58-844b-fb344c5c34bf None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:38.194300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907ff87-4b56-4a58-844b-fb344c5c34bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:38.234037 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c907ff87-4b56-4a58-844b-fb344c5c34bf None None] MFA Rules not processed for user `ada62513bec54142b14b79afadc04dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:38.235271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c907ff87-4b56-4a58-844b-fb344c5c34bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:38.322856 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1029/2053] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:38.337893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907ff87-4b56-4a58-844b-fb344c5c34bf None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:38.341855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c907ff87-4b56-4a58-844b-fb344c5c34bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:38.355606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00410ea7b05e487b9782563c5aea677f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:38.374051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00410ea7b05e487b9782563c5aea677f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:38.394068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1025/2054] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:37 2022] DELETE /identity/v3/users/00410ea7b05e487b9782563c5aea677f => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:38.432020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907ff87-4b56-4a58-844b-fb344c5c34bf None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:38.501892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46252-f691-45c3-8181-f92f57f026e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:38.502785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46252-f691-45c3-8181-f92f57f026e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:38.503265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46252-f691-45c3-8181-f92f57f026e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:38.503635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46252-f691-45c3-8181-f92f57f026e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:38.508781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-65a46252-f691-45c3-8181-f92f57f026e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:38.594032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a46252-f691-45c3-8181-f92f57f026e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:38.596813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a46252-f691-45c3-8181-f92f57f026e8 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:38.608223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1030/2055] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:39.024124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:39.148485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:39.148485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:39.236518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ffe2e-27bf-4c49-ae45-d13b6b16e036 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:39.244063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:39.244597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:39.244913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:39.245344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] PATH_INFO: `/v3/projects/cb709b87e93644dc9b2ff2c872889aa6` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:39.247216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb709b87e93644dc9b2ff2c872889aa6)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:39.248838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:39.590763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb709b87e93644dc9b2ff2c872889aa6', 'request_id': 'req-158515b0-836c-4a09-a1c2-de8e4701fa7d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:39.600812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb709b87e93644dc9b2ff2c872889aa6', 'request_id': 'req-158515b0-836c-4a09-a1c2-de8e4701fa7d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:39.645365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46252-f691-45c3-8181-f92f57f026e8 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:39.648525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-65a46252-f691-45c3-8181-f92f57f026e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:39.667839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46252-f691-45c3-8181-f92f57f026e8 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:39.777548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:39.778874 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:39.780491 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:39.781282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] PATH_INFO: `/v3/users/4c82efd9e39f4cf78f3e3a3de1e8bd29` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:39.783966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c82efd9e39f4cf78f3e3a3de1e8bd29)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:39.788365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:39.901077 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb709b87e93644dc9b2ff2c872889aa6', 'request_id': 'req-158515b0-836c-4a09-a1c2-de8e4701fa7d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:39.914023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] The token cache is being invalidate because project cb709b87e93644dc9b2ff2c872889aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:39.914602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:39.915464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-158515b0-836c-4a09-a1c2-de8e4701fa7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:39.917790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1026/2056] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:39 2022] DELETE /identity/v3/projects/cb709b87e93644dc9b2ff2c872889aa6 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:39.923301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1beb52-e817-42b5-b8d4-3b9b952ba2c2 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:39.924008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1beb52-e817-42b5-b8d4-3b9b952ba2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:39.924439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1beb52-e817-42b5-b8d4-3b9b952ba2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:39.948890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ff1beb52-e817-42b5-b8d4-3b9b952ba2c2 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:39.950575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ff1beb52-e817-42b5-b8d4-3b9b952ba2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:39.963590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1027/2057] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:39.972282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebffbf-ccf2-4266-a592-52d96ccc12cc None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:39.974108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebffbf-ccf2-4266-a592-52d96ccc12cc None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:39.974453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebffbf-ccf2-4266-a592-52d96ccc12cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:40.010518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-20ebffbf-ccf2-4266-a592-52d96ccc12cc None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:40.011609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-20ebffbf-ccf2-4266-a592-52d96ccc12cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:40.020846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1028/2058] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:40.026084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebffbf-ccf2-4266-a592-52d96ccc12cc None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:40.036304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebffbf-ccf2-4266-a592-52d96ccc12cc None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:40.042357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0841-dfd0-4703-8bae-b3aefe48de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:40.042981 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0841-dfd0-4703-8bae-b3aefe48de5d admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:40.043261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0841-dfd0-4703-8bae-b3aefe48de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:40.043529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0841-dfd0-4703-8bae-b3aefe48de5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:40.044222 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf0841-dfd0-4703-8bae-b3aefe48de5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:40.044521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf0841-dfd0-4703-8bae-b3aefe48de5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:40.046346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf0841-dfd0-4703-8bae-b3aefe48de5d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:40.070218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1029/2059] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:29:40.081465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0841-dfd0-4703-8bae-b3aefe48de5d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:40.103129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0841-dfd0-4703-8bae-b3aefe48de5d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:40.111724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c947d-0d16-4922-8007-602d1a559114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:40.112880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c947d-0d16-4922-8007-602d1a559114 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:40.113300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c947d-0d16-4922-8007-602d1a559114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:40.113906 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c947d-0d16-4922-8007-602d1a559114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:40.115647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c947d-0d16-4922-8007-602d1a559114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:40.119721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c947d-0d16-4922-8007-602d1a559114 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:40.384696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1030/2060] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:40 2022] POST /identity/v3/projects => generated 375 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:40.384696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c947d-0d16-4922-8007-602d1a559114 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:40.464613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c947d-0d16-4922-8007-602d1a559114 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:40.477471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c63c-666b-488f-8258-1a3465664720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:40.477471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c63c-666b-488f-8258-1a3465664720 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:40.477471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c63c-666b-488f-8258-1a3465664720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:40.477471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c63c-666b-488f-8258-1a3465664720 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:40.477859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036c63c-666b-488f-8258-1a3465664720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:40.477859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036c63c-666b-488f-8258-1a3465664720 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:40.685000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c82efd9e39f4cf78f3e3a3de1e8bd29'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:40.835622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1031/2061] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:40 2022] POST /identity/v3/users => generated 288 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:40.839742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c63c-666b-488f-8258-1a3465664720 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:40.849581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c63c-666b-488f-8258-1a3465664720 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:40.854181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13efe01-6f08-4120-abeb-ed86dbbf283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:40.854782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13efe01-6f08-4120-abeb-ed86dbbf283d admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:40.855061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13efe01-6f08-4120-abeb-ed86dbbf283d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:40.855333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13efe01-6f08-4120-abeb-ed86dbbf283d admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:40.855994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13efe01-6f08-4120-abeb-ed86dbbf283d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:40.857565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13efe01-6f08-4120-abeb-ed86dbbf283d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:40.868007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1032/2062] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:40.872018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13efe01-6f08-4120-abeb-ed86dbbf283d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:40.881841 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13efe01-6f08-4120-abeb-ed86dbbf283d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:40.886415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239ebb0-3634-4265-a909-ec877672fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:40.886954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ebb0-3634-4265-a909-ec877672fc21 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:40.887231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ebb0-3634-4265-a909-ec877672fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:40.887500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ebb0-3634-4265-a909-ec877672fc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:40.888117 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239ebb0-3634-4265-a909-ec877672fc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:40.889816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239ebb0-3634-4265-a909-ec877672fc21 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:40.899966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1033/2063] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:40.904145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239ebb0-3634-4265-a909-ec877672fc21 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:40.913445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239ebb0-3634-4265-a909-ec877672fc21 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:40.918168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a0841-4a4f-40ef-a085-7d84f5e3a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:40.918788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a0841-4a4f-40ef-a085-7d84f5e3a0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:40.919068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a0841-4a4f-40ef-a085-7d84f5e3a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:40.919342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a0841-4a4f-40ef-a085-7d84f5e3a0a7 admin admin] PATH_INFO: `/v3/projects/83f6e2ae72954e598cdb0344d2bb2faa/users/037f3e2a8e4045e68233c5123b063874/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:40.934106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a0841-4a4f-40ef-a085-7d84f5e3a0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f6e2ae72954e598cdb0344d2bb2faa, user_id=037f3e2a8e4045e68233c5123b063874, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:40.936731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a0841-4a4f-40ef-a085-7d84f5e3a0a7 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:40.985494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c82efd9e39f4cf78f3e3a3de1e8bd29'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:40.986417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c82efd9e39f4cf78f3e3a3de1e8bd29'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:41.013318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c82efd9e39f4cf78f3e3a3de1e8bd29'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:41.014685 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0918b500-83ea-4a1a-932a-b8f86cdde1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c82efd9e39f4cf78f3e3a3de1e8bd29'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:41.042379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1031/2064] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:39 2022] DELETE /identity/v3/users/4c82efd9e39f4cf78f3e3a3de1e8bd29 => generated 0 bytes in 1397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:41.047293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7992c1a-9f4f-43c3-9479-20c8af955744 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:41.047602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7992c1a-9f4f-43c3-9479-20c8af955744 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:41.048048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7992c1a-9f4f-43c3-9479-20c8af955744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:41.069896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c7992c1a-9f4f-43c3-9479-20c8af955744 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:41.071312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c7992c1a-9f4f-43c3-9479-20c8af955744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:41.166406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1032/2065] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:41.173413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7992c1a-9f4f-43c3-9479-20c8af955744 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:41.174997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c7992c1a-9f4f-43c3-9479-20c8af955744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:41.243926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7992c1a-9f4f-43c3-9479-20c8af955744 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:41.247582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f81904-c9ad-4fde-b388-9a9f1c9ecf86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:41.248190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81904-c9ad-4fde-b388-9a9f1c9ecf86 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:41.248470 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81904-c9ad-4fde-b388-9a9f1c9ecf86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:41.248761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f81904-c9ad-4fde-b388-9a9f1c9ecf86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:41.258118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f81904-c9ad-4fde-b388-9a9f1c9ecf86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:41.259544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f81904-c9ad-4fde-b388-9a9f1c9ecf86 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:41.269623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1033/2066] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:41.290851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1034/2067] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:40 2022] PUT /identity/v3/projects/83f6e2ae72954e598cdb0344d2bb2faa/users/037f3e2a8e4045e68233c5123b063874/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:41.302192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026c9b3-f460-4a9a-9aa7-789ca0a461d6 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:41.303106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026c9b3-f460-4a9a-9aa7-789ca0a461d6 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:41.303343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026c9b3-f460-4a9a-9aa7-789ca0a461d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:41.339186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-d026c9b3-f460-4a9a-9aa7-789ca0a461d6 None None] MFA Rules not processed for user `037f3e2a8e4045e68233c5123b063874`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:41.340823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d026c9b3-f460-4a9a-9aa7-789ca0a461d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:41.431866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1034/2068] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:41.450588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a0841-4a4f-40ef-a085-7d84f5e3a0a7 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:41.452727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c38a0841-4a4f-40ef-a085-7d84f5e3a0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:41.527213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a0841-4a4f-40ef-a085-7d84f5e3a0a7 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:41.531236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873839e-26ab-4a1e-b9b8-73e34ac91d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:41.531856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873839e-26ab-4a1e-b9b8-73e34ac91d7b service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:41.532140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873839e-26ab-4a1e-b9b8-73e34ac91d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:41.532412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873839e-26ab-4a1e-b9b8-73e34ac91d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:41.541642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873839e-26ab-4a1e-b9b8-73e34ac91d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:41.543482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873839e-26ab-4a1e-b9b8-73e34ac91d7b service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:41.554780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1035/2069] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:42.016527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026c9b3-f460-4a9a-9aa7-789ca0a461d6 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:42.018054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d026c9b3-f460-4a9a-9aa7-789ca0a461d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:42.094699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026c9b3-f460-4a9a-9aa7-789ca0a461d6 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:42.100585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:42.101387 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:42.101695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:42.101996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] PATH_INFO: `/v3/projects/d57c9acf41df47599a4b9b3f655ea6ab` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:42.103185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57c9acf41df47599a4b9b3f655ea6ab)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:42.105129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:42.256920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57c9acf41df47599a4b9b3f655ea6ab', 'request_id': 'req-06da24ac-9c3c-4514-a4c7-428215e865b7'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:42.263856 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57c9acf41df47599a4b9b3f655ea6ab', 'request_id': 'req-06da24ac-9c3c-4514-a4c7-428215e865b7'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:42.361835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57c9acf41df47599a4b9b3f655ea6ab', 'request_id': 'req-06da24ac-9c3c-4514-a4c7-428215e865b7'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:42.375712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] The token cache is being invalidate because project d57c9acf41df47599a4b9b3f655ea6ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:42.377099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:42.378368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:42.380196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1035/2070] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:42 2022] DELETE /identity/v3/projects/d57c9acf41df47599a4b9b3f655ea6ab => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:42.384292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873839e-26ab-4a1e-b9b8-73e34ac91d7b service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:42.398773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873839e-26ab-4a1e-b9b8-73e34ac91d7b service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:42.471827 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:42.472832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:42.473293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:42.473917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] PATH_INFO: `/v3/users/a36293418a8a45bda7f39252425d4d56` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:42.476304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36293418a8a45bda7f39252425d4d56)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:42.479692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:42.672031 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:42.673432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:42.738192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da24ac-9c3c-4514-a4c7-428215e865b7 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:42.743018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2fee9-65f2-4316-9192-5fa01e5230dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:42.743900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2fee9-65f2-4316-9192-5fa01e5230dc service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:42.744286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2fee9-65f2-4316-9192-5fa01e5230dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:42.744665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2fee9-65f2-4316-9192-5fa01e5230dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:42.747076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-95f2fee9-65f2-4316-9192-5fa01e5230dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:42.815694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2fee9-65f2-4316-9192-5fa01e5230dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:42.817174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2fee9-65f2-4316-9192-5fa01e5230dc service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:42.828708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1036/2071] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:42.904807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36293418a8a45bda7f39252425d4d56'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:42.905615 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36293418a8a45bda7f39252425d4d56'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:42.906255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36293418a8a45bda7f39252425d4d56'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:43.044347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36293418a8a45bda7f39252425d4d56'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:43.060136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf058d71-f6d1-4db1-a8a6-50d695f1059c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36293418a8a45bda7f39252425d4d56'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:43.080139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1036/2072] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:42 2022] DELETE /identity/v3/users/a36293418a8a45bda7f39252425d4d56 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:43.238727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:43.606713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2fee9-65f2-4316-9192-5fa01e5230dc service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:43.609042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-95f2fee9-65f2-4316-9192-5fa01e5230dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:43.633389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2fee9-65f2-4316-9192-5fa01e5230dc service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:43.687857 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:43.699463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:43.700118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:43.700398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:43.700671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] PATH_INFO: `/v3/projects/e327f7e2e3c642b99f4c6a38e6ecbf96` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:43.702527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e327f7e2e3c642b99f4c6a38e6ecbf96)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:43.703879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:43.876720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e327f7e2e3c642b99f4c6a38e6ecbf96', 'request_id': 'req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:43.883310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e327f7e2e3c642b99f4c6a38e6ecbf96', 'request_id': 'req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:44.018327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e327f7e2e3c642b99f4c6a38e6ecbf96', 'request_id': 'req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:44.031326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] The token cache is being invalidate because project e327f7e2e3c642b99f4c6a38e6ecbf96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:44.031621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:44.032333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-35b9cb0a-3415-4fc9-af5b-ef4b0963414f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:44.033987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1037/2073] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:43 2022] DELETE /identity/v3/projects/e327f7e2e3c642b99f4c6a38e6ecbf96 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:44.039009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bc0bb-d12e-40e6-af55-97402daaa3e9 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.039485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bc0bb-d12e-40e6-af55-97402daaa3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.039798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bc0bb-d12e-40e6-af55-97402daaa3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.060123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-043bc0bb-d12e-40e6-af55-97402daaa3e9 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:44.061338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-043bc0bb-d12e-40e6-af55-97402daaa3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:44.132096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1037/2074] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:44.148370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609a13-1f6b-45be-bf2d-6156264b73f7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.148773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609a13-1f6b-45be-bf2d-6156264b73f7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.149281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609a13-1f6b-45be-bf2d-6156264b73f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.178186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-17609a13-1f6b-45be-bf2d-6156264b73f7 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:44.179416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-17609a13-1f6b-45be-bf2d-6156264b73f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:44.190318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1038/2075] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:44.211435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bc0bb-d12e-40e6-af55-97402daaa3e9 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:44.225257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bc0bb-d12e-40e6-af55-97402daaa3e9 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:44.230652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519640e8-8a1a-4829-a376-54e7577ec842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:44.231539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519640e8-8a1a-4829-a376-54e7577ec842 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.232363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519640e8-8a1a-4829-a376-54e7577ec842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.232363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519640e8-8a1a-4829-a376-54e7577ec842 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.232897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519640e8-8a1a-4829-a376-54e7577ec842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:44.233207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519640e8-8a1a-4829-a376-54e7577ec842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:44.234968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519640e8-8a1a-4829-a376-54e7577ec842 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:44.249781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1038/2076] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:44.254602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17609a13-1f6b-45be-bf2d-6156264b73f7 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:44.268892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17609a13-1f6b-45be-bf2d-6156264b73f7 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:44.275007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105443a2-77b7-453b-b981-c5239ce3d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:44.276536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105443a2-77b7-453b-b981-c5239ce3d523 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.276536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105443a2-77b7-453b-b981-c5239ce3d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.276536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105443a2-77b7-453b-b981-c5239ce3d523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.277384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105443a2-77b7-453b-b981-c5239ce3d523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:44.282229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105443a2-77b7-453b-b981-c5239ce3d523 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:44.409036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1039/2077] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:44 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:44.414088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519640e8-8a1a-4829-a376-54e7577ec842 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:44.425219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519640e8-8a1a-4829-a376-54e7577ec842 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:44.490315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bd624-62b1-4f77-95a2-26a73e0c5860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:44.490974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bd624-62b1-4f77-95a2-26a73e0c5860 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.491261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bd624-62b1-4f77-95a2-26a73e0c5860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.491545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bd624-62b1-4f77-95a2-26a73e0c5860 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.492204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bd624-62b1-4f77-95a2-26a73e0c5860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:44.494182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bd624-62b1-4f77-95a2-26a73e0c5860 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:44.605617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1039/2078] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:44 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:44.609791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105443a2-77b7-453b-b981-c5239ce3d523 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:44.620405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105443a2-77b7-453b-b981-c5239ce3d523 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:44.626077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201d868-8c64-4f29-9708-ee648f03fba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:44.626703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201d868-8c64-4f29-9708-ee648f03fba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.627039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201d868-8c64-4f29-9708-ee648f03fba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.627262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201d868-8c64-4f29-9708-ee648f03fba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.627918 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201d868-8c64-4f29-9708-ee648f03fba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:44.630141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201d868-8c64-4f29-9708-ee648f03fba5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:44.643252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1040/2079] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:44.646003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bd624-62b1-4f77-95a2-26a73e0c5860 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:44.663912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bd624-62b1-4f77-95a2-26a73e0c5860 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:44.669326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139346f4-7167-423e-a3b3-9ee34dcb0544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:44.670135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139346f4-7167-423e-a3b3-9ee34dcb0544 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.670640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139346f4-7167-423e-a3b3-9ee34dcb0544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.683411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139346f4-7167-423e-a3b3-9ee34dcb0544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.683411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139346f4-7167-423e-a3b3-9ee34dcb0544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:44.683411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139346f4-7167-423e-a3b3-9ee34dcb0544 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:44.698206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1040/2080] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:44.699064 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201d868-8c64-4f29-9708-ee648f03fba5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:44.719260 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201d868-8c64-4f29-9708-ee648f03fba5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:44.725475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ef755-0c26-4c85-bb68-f45b9997c2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:44.728906 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ef755-0c26-4c85-bb68-f45b9997c2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.728906 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ef755-0c26-4c85-bb68-f45b9997c2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.730095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:44.730493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ef755-0c26-4c85-bb68-f45b9997c2c4 admin admin] PATH_INFO: `/v3/projects/928a902fd2f54d4c98c48b333744895b/users/51d13ab305dc4baba7532d3c6b174990/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.762601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ef755-0c26-4c85-bb68-f45b9997c2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928a902fd2f54d4c98c48b333744895b, user_id=51d13ab305dc4baba7532d3c6b174990, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:44.765785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ef755-0c26-4c85-bb68-f45b9997c2c4 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:44.918900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1041/2081] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:44 2022] PUT /identity/v3/projects/928a902fd2f54d4c98c48b333744895b/users/51d13ab305dc4baba7532d3c6b174990/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:44.929457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c72c5-ce29-4a60-91be-752f1d35fb57 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.929777 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c72c5-ce29-4a60-91be-752f1d35fb57 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.930057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c72c5-ce29-4a60-91be-752f1d35fb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.964130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1f2c72c5-ce29-4a60-91be-752f1d35fb57 None None] MFA Rules not processed for user `51d13ab305dc4baba7532d3c6b174990`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:44.965383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1f2c72c5-ce29-4a60-91be-752f1d35fb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:45.017350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ef755-0c26-4c85-bb68-f45b9997c2c4 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:45.019176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d15ef755-0c26-4c85-bb68-f45b9997c2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:45.040242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1041/2082] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:45.042125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c72c5-ce29-4a60-91be-752f1d35fb57 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:45.085649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ef755-0c26-4c85-bb68-f45b9997c2c4 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:45.089421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6f8b-33e6-4d7b-b9c7-c5396608eb9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:45.090081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6f8b-33e6-4d7b-b9c7-c5396608eb9a service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.090358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6f8b-33e6-4d7b-b9c7-c5396608eb9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.090625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d6f8b-33e6-4d7b-b9c7-c5396608eb9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.092384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d80d6f8b-33e6-4d7b-b9c7-c5396608eb9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:45.111565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c72c5-ce29-4a60-91be-752f1d35fb57 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:45.116820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e987f-acb8-42c4-a816-1020ff86bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:45.117435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e987f-acb8-42c4-a816-1020ff86bb41 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.117773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e987f-acb8-42c4-a816-1020ff86bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.118053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e987f-acb8-42c4-a816-1020ff86bb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.118706 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e987f-acb8-42c4-a816-1020ff86bb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:45.120628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e987f-acb8-42c4-a816-1020ff86bb41 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:45.159022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6f8b-33e6-4d7b-b9c7-c5396608eb9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:45.160524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d6f8b-33e6-4d7b-b9c7-c5396608eb9a service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:45.170557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1042/2083] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:45.258544 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1042/2084] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:45 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:45.269183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6f8b-33e6-4d7b-b9c7-c5396608eb9a service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:45.284434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d6f8b-33e6-4d7b-b9c7-c5396608eb9a service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:45.350295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0b08b-aa45-4087-9300-b64ffcbf16ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:45.362022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0b08b-aa45-4087-9300-b64ffcbf16ce admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.362022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0b08b-aa45-4087-9300-b64ffcbf16ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.362022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0b08b-aa45-4087-9300-b64ffcbf16ce admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.362022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0b08b-aa45-4087-9300-b64ffcbf16ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:45.362022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0b08b-aa45-4087-9300-b64ffcbf16ce admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:45.513763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:45.529647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1043/2085] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:45 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:45.531980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e987f-acb8-42c4-a816-1020ff86bb41 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:45.551227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e987f-acb8-42c4-a816-1020ff86bb41 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:45.558219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e0762-1bc9-4e5d-a771-8b7a7ef26507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:45.559343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e0762-1bc9-4e5d-a771-8b7a7ef26507 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.559918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e0762-1bc9-4e5d-a771-8b7a7ef26507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.560320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e0762-1bc9-4e5d-a771-8b7a7ef26507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.561779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e0762-1bc9-4e5d-a771-8b7a7ef26507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:45.564419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e0762-1bc9-4e5d-a771-8b7a7ef26507 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:45.580457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1043/2086] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:45.583295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0b08b-aa45-4087-9300-b64ffcbf16ce admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:45.594520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0b08b-aa45-4087-9300-b64ffcbf16ce admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:45.599151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4fe01-8afd-430f-be59-b3a7fd7bcc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:45.600327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4fe01-8afd-430f-be59-b3a7fd7bcc3d admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.600609 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4fe01-8afd-430f-be59-b3a7fd7bcc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.601892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4fe01-8afd-430f-be59-b3a7fd7bcc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.601892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4fe01-8afd-430f-be59-b3a7fd7bcc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:45.603429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4fe01-8afd-430f-be59-b3a7fd7bcc3d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:45.617073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1044/2087] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:45.625040 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e0762-1bc9-4e5d-a771-8b7a7ef26507 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:45.635214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e0762-1bc9-4e5d-a771-8b7a7ef26507 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:45.640082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16097-52cd-4b21-82ad-b54e598b6e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:45.640925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16097-52cd-4b21-82ad-b54e598b6e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.641232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16097-52cd-4b21-82ad-b54e598b6e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.641531 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e16097-52cd-4b21-82ad-b54e598b6e8b admin admin] PATH_INFO: `/v3/projects/4e3d63f464844ca7864fa401cd436fd5/users/c0ae617835194053b1ee7331886bf1e1/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.660149 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e16097-52cd-4b21-82ad-b54e598b6e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3d63f464844ca7864fa401cd436fd5, user_id=c0ae617835194053b1ee7331886bf1e1, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:45.666087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e16097-52cd-4b21-82ad-b54e598b6e8b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:45.780358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1044/2088] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:45 2022] PUT /identity/v3/projects/4e3d63f464844ca7864fa401cd436fd5/users/c0ae617835194053b1ee7331886bf1e1/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:45.794880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f4e7-f7fe-49c1-aa5a-cd62f0dd90b9 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.795178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f4e7-f7fe-49c1-aa5a-cd62f0dd90b9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.795464 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083f4e7-f7fe-49c1-aa5a-cd62f0dd90b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.832365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4083f4e7-f7fe-49c1-aa5a-cd62f0dd90b9 None None] MFA Rules not processed for user `c0ae617835194053b1ee7331886bf1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:45.833801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4083f4e7-f7fe-49c1-aa5a-cd62f0dd90b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:45.913055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1045/2089] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:45.917998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16097-52cd-4b21-82ad-b54e598b6e8b admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:45.984409 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e16097-52cd-4b21-82ad-b54e598b6e8b admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:45.991403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d0936-0c27-49c2-9014-c060d4f0090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:45.992543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d0936-0c27-49c2-9014-c060d4f0090c admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:45.992870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d0936-0c27-49c2-9014-c060d4f0090c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:45.993246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d0936-0c27-49c2-9014-c060d4f0090c admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:45.994055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d0936-0c27-49c2-9014-c060d4f0090c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:45.996189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d0936-0c27-49c2-9014-c060d4f0090c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:46.218792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f4e7-f7fe-49c1-aa5a-cd62f0dd90b9 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:46.229215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1045/2090] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:45 2022] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:46.231950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083f4e7-f7fe-49c1-aa5a-cd62f0dd90b9 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:46.297840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dfbaf-6ba0-4780-9d4e-e10c79a89911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:46.298457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dfbaf-6ba0-4780-9d4e-e10c79a89911 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:46.298735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dfbaf-6ba0-4780-9d4e-e10c79a89911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:46.299008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dfbaf-6ba0-4780-9d4e-e10c79a89911 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:46.299639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dfbaf-6ba0-4780-9d4e-e10c79a89911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:46.301640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dfbaf-6ba0-4780-9d4e-e10c79a89911 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:46.427396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1046/2091] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:46 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:46.433553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d0936-0c27-49c2-9014-c060d4f0090c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:46.444064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d0936-0c27-49c2-9014-c060d4f0090c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:46.449146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986d65e-e8bc-48b8-8d70-f5312c1e2a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:46.449786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d65e-e8bc-48b8-8d70-f5312c1e2a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:46.450068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d65e-e8bc-48b8-8d70-f5312c1e2a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:46.450343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d65e-e8bc-48b8-8d70-f5312c1e2a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:46.450990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986d65e-e8bc-48b8-8d70-f5312c1e2a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:46.452797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986d65e-e8bc-48b8-8d70-f5312c1e2a90 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:46.464331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1046/2092] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:46.468758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dfbaf-6ba0-4780-9d4e-e10c79a89911 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:46.480573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dfbaf-6ba0-4780-9d4e-e10c79a89911 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:46.485545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd35c-ab7b-4ab4-a88c-54147a7f56b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:46.486246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd35c-ab7b-4ab4-a88c-54147a7f56b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:46.486523 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd35c-ab7b-4ab4-a88c-54147a7f56b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:46.486798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd35c-ab7b-4ab4-a88c-54147a7f56b5 admin admin] PATH_INFO: `/v3/projects/c513f0e7a2af4de3a3fb218c11da3fc7/users/cc02964b40fa4ffb8f54d47ed9c5d573/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:46.509131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bd35c-ab7b-4ab4-a88c-54147a7f56b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c513f0e7a2af4de3a3fb218c11da3fc7, user_id=cc02964b40fa4ffb8f54d47ed9c5d573, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:46.509131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bd35c-ab7b-4ab4-a88c-54147a7f56b5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:46.532995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:46.634731 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1047/2093] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:46 2022] PUT /identity/v3/projects/c513f0e7a2af4de3a3fb218c11da3fc7/users/cc02964b40fa4ffb8f54d47ed9c5d573/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:46.638674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986d65e-e8bc-48b8-8d70-f5312c1e2a90 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:46.655695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986d65e-e8bc-48b8-8d70-f5312c1e2a90 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:46.755936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d39e4-fe82-404b-920e-b06c23cf0408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:46.756815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d39e4-fe82-404b-920e-b06c23cf0408 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:46.757261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d39e4-fe82-404b-920e-b06c23cf0408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:46.757548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d39e4-fe82-404b-920e-b06c23cf0408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:46.758244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d39e4-fe82-404b-920e-b06c23cf0408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:46.764242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d39e4-fe82-404b-920e-b06c23cf0408 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:46.775656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1047/2094] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:46.776987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd35c-ab7b-4ab4-a88c-54147a7f56b5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:46.797337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd35c-ab7b-4ab4-a88c-54147a7f56b5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:46.804261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7017978-a355-438a-8b77-40c4f3ae5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:46.805654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7017978-a355-438a-8b77-40c4f3ae5d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:46.806131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7017978-a355-438a-8b77-40c4f3ae5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:46.806597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7017978-a355-438a-8b77-40c4f3ae5d0e admin admin] PATH_INFO: `/v3/projects/c513f0e7a2af4de3a3fb218c11da3fc7/users/cc02964b40fa4ffb8f54d47ed9c5d573/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:46.809031 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7017978-a355-438a-8b77-40c4f3ae5d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c513f0e7a2af4de3a3fb218c11da3fc7, user_id=cc02964b40fa4ffb8f54d47ed9c5d573, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:46.815237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7017978-a355-438a-8b77-40c4f3ae5d0e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:46.831972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1048/2095] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:46 2022] PUT /identity/v3/projects/c513f0e7a2af4de3a3fb218c11da3fc7/users/cc02964b40fa4ffb8f54d47ed9c5d573/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:46.844265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351267d-b06e-4e1f-82dd-c5ec6b81612c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:46.844834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351267d-b06e-4e1f-82dd-c5ec6b81612c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:46.844937 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351267d-b06e-4e1f-82dd-c5ec6b81612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:46.876986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-d351267d-b06e-4e1f-82dd-c5ec6b81612c None None] MFA Rules not processed for user `cc02964b40fa4ffb8f54d47ed9c5d573`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:46.878282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d351267d-b06e-4e1f-82dd-c5ec6b81612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:46.968953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1048/2096] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:46.981460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7017978-a355-438a-8b77-40c4f3ae5d0e admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:46.983249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e7017978-a355-438a-8b77-40c4f3ae5d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:47.054012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7017978-a355-438a-8b77-40c4f3ae5d0e admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:47.058033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb817a87-bf7b-4168-9722-cf4326c19830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:47.058676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb817a87-bf7b-4168-9722-cf4326c19830 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:47.058963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb817a87-bf7b-4168-9722-cf4326c19830 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:47.059242 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb817a87-bf7b-4168-9722-cf4326c19830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:47.131570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb817a87-bf7b-4168-9722-cf4326c19830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:47.133340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb817a87-bf7b-4168-9722-cf4326c19830 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:47.144514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1049/2097] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:48.131115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351267d-b06e-4e1f-82dd-c5ec6b81612c None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:48.133498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d351267d-b06e-4e1f-82dd-c5ec6b81612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:48.163475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:48.257568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351267d-b06e-4e1f-82dd-c5ec6b81612c None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:48.262872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:48.265118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.265118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.265118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] PATH_INFO: `/v3/users/037f3e2a8e4045e68233c5123b063874` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.265450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=037f3e2a8e4045e68233c5123b063874)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:48.267578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:48.536578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037f3e2a8e4045e68233c5123b063874'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.537873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037f3e2a8e4045e68233c5123b063874'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.538715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037f3e2a8e4045e68233c5123b063874'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.701359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037f3e2a8e4045e68233c5123b063874'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.719172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037f3e2a8e4045e68233c5123b063874'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.734916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1049/2098] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:48 2022] DELETE /identity/v3/users/037f3e2a8e4045e68233c5123b063874 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:48.739798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2820e-d474-4f33-93ab-cadeb66ec782 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.740168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2820e-d474-4f33-93ab-cadeb66ec782 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.741028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2820e-d474-4f33-93ab-cadeb66ec782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.766203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-81d2820e-d474-4f33-93ab-cadeb66ec782 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:48.767903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-81d2820e-d474-4f33-93ab-cadeb66ec782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:48.844616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1050/2099] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:48.858934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:48.861098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:48.932276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c477e-73ca-4404-a099-72ab9653f4ce admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:48.939001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b0b98-19e2-4e18-9e5e-d6ad9bb29189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:48.940351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b0b98-19e2-4e18-9e5e-d6ad9bb29189 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.941576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b0b98-19e2-4e18-9e5e-d6ad9bb29189 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.942778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b0b98-19e2-4e18-9e5e-d6ad9bb29189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.956166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b0b98-19e2-4e18-9e5e-d6ad9bb29189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:48.957647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b0b98-19e2-4e18-9e5e-d6ad9bb29189 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:48.970363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1050/2100] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:49.638000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2820e-d474-4f33-93ab-cadeb66ec782 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:49.640824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-81d2820e-d474-4f33-93ab-cadeb66ec782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:49.659833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2820e-d474-4f33-93ab-cadeb66ec782 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:49.678935 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:49.679937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:49.680279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:49.680602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] PATH_INFO: `/v3/projects/83f6e2ae72954e598cdb0344d2bb2faa` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:49.683152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f6e2ae72954e598cdb0344d2bb2faa)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:49.686110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:49.894030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f6e2ae72954e598cdb0344d2bb2faa', 'request_id': 'req-6b64039c-4dd1-4456-9724-b251555f6081'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:49.901884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f6e2ae72954e598cdb0344d2bb2faa', 'request_id': 'req-6b64039c-4dd1-4456-9724-b251555f6081'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:50.107610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f6e2ae72954e598cdb0344d2bb2faa', 'request_id': 'req-6b64039c-4dd1-4456-9724-b251555f6081'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:50.130017 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] The token cache is being invalidate because project 83f6e2ae72954e598cdb0344d2bb2faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:50.130409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:50.131787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b64039c-4dd1-4456-9724-b251555f6081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:50.134175 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:50.136204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1051/2101] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:49 2022] DELETE /identity/v3/projects/83f6e2ae72954e598cdb0344d2bb2faa => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:50.141334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe124-7de2-40b3-b55e-5ef20cfda122 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:50.146006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe124-7de2-40b3-b55e-5ef20cfda122 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:50.146006 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe124-7de2-40b3-b55e-5ef20cfda122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:50.172707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-d06fe124-7de2-40b3-b55e-5ef20cfda122 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:50.174040 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d06fe124-7de2-40b3-b55e-5ef20cfda122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:50.269790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1051/2102] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:50.277789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787be6-93c6-4ad7-88cb-e468bd87d7d8 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:50.278080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787be6-93c6-4ad7-88cb-e468bd87d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:50.278717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787be6-93c6-4ad7-88cb-e468bd87d7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:50.298585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a4787be6-93c6-4ad7-88cb-e468bd87d7d8 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:50.299832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a4787be6-93c6-4ad7-88cb-e468bd87d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:50.315971 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1052/2103] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:50.321382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe124-7de2-40b3-b55e-5ef20cfda122 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:50.336632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe124-7de2-40b3-b55e-5ef20cfda122 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:50.342169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1585c8-4768-4baa-93ce-bd420286f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:50.343377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1585c8-4768-4baa-93ce-bd420286f453 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:50.343985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1585c8-4768-4baa-93ce-bd420286f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:50.344411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1585c8-4768-4baa-93ce-bd420286f453 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:50.345263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1585c8-4768-4baa-93ce-bd420286f453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:50.345761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1585c8-4768-4baa-93ce-bd420286f453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:50.347639 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1585c8-4768-4baa-93ce-bd420286f453 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:50.364274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1052/2104] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:50.370338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787be6-93c6-4ad7-88cb-e468bd87d7d8 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:50.380799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787be6-93c6-4ad7-88cb-e468bd87d7d8 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:50.388634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9488bdb-bcf0-40de-8596-371363be7ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:50.389303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9488bdb-bcf0-40de-8596-371363be7ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:50.389833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9488bdb-bcf0-40de-8596-371363be7ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:50.390280 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9488bdb-bcf0-40de-8596-371363be7ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:50.391147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9488bdb-bcf0-40de-8596-371363be7ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:50.404220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9488bdb-bcf0-40de-8596-371363be7ce3 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:50.601696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1053/2105] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:50 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:50.608766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1585c8-4768-4baa-93ce-bd420286f453 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:50.619641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1585c8-4768-4baa-93ce-bd420286f453 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:50.647243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9488bdb-bcf0-40de-8596-371363be7ce3 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:50.650712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e9488bdb-bcf0-40de-8596-371363be7ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:50.741791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9488bdb-bcf0-40de-8596-371363be7ce3 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:50.747104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:50.747778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:50.748061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:50.748337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] PATH_INFO: `/v3/users/fb4ecdfb04cb435a9569e84080a236e2` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:50.750272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4ecdfb04cb435a9569e84080a236e2)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:50.752880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:50.756822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91922be-21ef-4eb7-9ba8-e871fbdf2294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:50.758691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91922be-21ef-4eb7-9ba8-e871fbdf2294 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:50.759201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91922be-21ef-4eb7-9ba8-e871fbdf2294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:50.759636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91922be-21ef-4eb7-9ba8-e871fbdf2294 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:50.760652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91922be-21ef-4eb7-9ba8-e871fbdf2294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:50.764529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91922be-21ef-4eb7-9ba8-e871fbdf2294 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:50.931527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1053/2106] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:50 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:50.932360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91922be-21ef-4eb7-9ba8-e871fbdf2294 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:50.934042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e91922be-21ef-4eb7-9ba8-e871fbdf2294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:51.007573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91922be-21ef-4eb7-9ba8-e871fbdf2294 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:51.015127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11134c-8330-403d-b4f5-cbc8e77e398b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:51.016501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11134c-8330-403d-b4f5-cbc8e77e398b service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:51.016856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11134c-8330-403d-b4f5-cbc8e77e398b service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:51.017138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11134c-8330-403d-b4f5-cbc8e77e398b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:51.019651 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6a11134c-8330-403d-b4f5-cbc8e77e398b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:51.061755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4ecdfb04cb435a9569e84080a236e2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:51.085965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11134c-8330-403d-b4f5-cbc8e77e398b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:51.087437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11134c-8330-403d-b4f5-cbc8e77e398b service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:51.096418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1054/2107] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:51.097212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11134c-8330-403d-b4f5-cbc8e77e398b service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:51.108050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11134c-8330-403d-b4f5-cbc8e77e398b service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:51.112848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abef31-ce6d-4fcd-86b9-d42d97686166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:51.113446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abef31-ce6d-4fcd-86b9-d42d97686166 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:51.113759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abef31-ce6d-4fcd-86b9-d42d97686166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:51.114035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abef31-ce6d-4fcd-86b9-d42d97686166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:51.114675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abef31-ce6d-4fcd-86b9-d42d97686166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:51.116896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abef31-ce6d-4fcd-86b9-d42d97686166 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:51.127146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1055/2108] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:51.131368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abef31-ce6d-4fcd-86b9-d42d97686166 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:51.140802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abef31-ce6d-4fcd-86b9-d42d97686166 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:51.146263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e400c9-8814-46fe-91ee-31d2bcd8c019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:51.147350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e400c9-8814-46fe-91ee-31d2bcd8c019 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:51.147623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e400c9-8814-46fe-91ee-31d2bcd8c019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:51.147892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e400c9-8814-46fe-91ee-31d2bcd8c019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:51.148528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e400c9-8814-46fe-91ee-31d2bcd8c019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:51.150134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e400c9-8814-46fe-91ee-31d2bcd8c019 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:51.163129 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1056/2109] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:51.167804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e400c9-8814-46fe-91ee-31d2bcd8c019 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:51.177987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4ecdfb04cb435a9569e84080a236e2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:51.178243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e400c9-8814-46fe-91ee-31d2bcd8c019 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:51.178911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4ecdfb04cb435a9569e84080a236e2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:51.184274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7e98-e303-449b-b109-56b5026680f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:51.184862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7e98-e303-449b-b109-56b5026680f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:51.185894 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7e98-e303-449b-b109-56b5026680f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:51.185894 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7e98-e303-449b-b109-56b5026680f6 admin admin] PATH_INFO: `/v3/projects/93e22d68b37e4ae0842cb1f494ae8cf3/users/c5e452e8294446cd9b681c83a180d037/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:51.193610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4ecdfb04cb435a9569e84080a236e2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:51.194514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7f3c787e-39c1-46f9-a190-f5fb475ef15d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4ecdfb04cb435a9569e84080a236e2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:51.200805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b7e98-e303-449b-b109-56b5026680f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e22d68b37e4ae0842cb1f494ae8cf3, user_id=c5e452e8294446cd9b681c83a180d037, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:51.205744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b7e98-e303-449b-b109-56b5026680f6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:51.210096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1054/2110] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:50 2022] DELETE /identity/v3/users/fb4ecdfb04cb435a9569e84080a236e2 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:51.326960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1057/2111] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:51 2022] PUT /identity/v3/projects/93e22d68b37e4ae0842cb1f494ae8cf3/users/c5e452e8294446cd9b681c83a180d037/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:51.338514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b482054-9544-4837-9ab9-ec4abf980b35 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:51.338813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b482054-9544-4837-9ab9-ec4abf980b35 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:51.339096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b482054-9544-4837-9ab9-ec4abf980b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:51.374930 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9b482054-9544-4837-9ab9-ec4abf980b35 None None] MFA Rules not processed for user `c5e452e8294446cd9b681c83a180d037`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:51.376193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9b482054-9544-4837-9ab9-ec4abf980b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:51.408238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7e98-e303-449b-b109-56b5026680f6 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:51.410048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-329b7e98-e303-449b-b109-56b5026680f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:51.416277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:51.452332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1055/2112] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:51.467947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b482054-9544-4837-9ab9-ec4abf980b35 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:51.470905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9b482054-9544-4837-9ab9-ec4abf980b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:51.482055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7e98-e303-449b-b109-56b5026680f6 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:51.499244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:51.500311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:51.500592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:51.500867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] PATH_INFO: `/v3/users/75773043ef6743859329ae16afe18bc0` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:51.503118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75773043ef6743859329ae16afe18bc0)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:51.504543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:51.576708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b482054-9544-4837-9ab9-ec4abf980b35 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:51.580359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27a1ed-dbbc-4525-bdb7-1485e91c6dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:51.580968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a1ed-dbbc-4525-bdb7-1485e91c6dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:51.581247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a1ed-dbbc-4525-bdb7-1485e91c6dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:51.581523 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a1ed-dbbc-4525-bdb7-1485e91c6dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:51.590864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27a1ed-dbbc-4525-bdb7-1485e91c6dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:51.592438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27a1ed-dbbc-4525-bdb7-1485e91c6dc0 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:51.602309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1056/2113] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:51.603129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27a1ed-dbbc-4525-bdb7-1485e91c6dc0 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:51.604403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ee27a1ed-dbbc-4525-bdb7-1485e91c6dc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:51.619923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27a1ed-dbbc-4525-bdb7-1485e91c6dc0 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:51.625505 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:51.626234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:51.626518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:51.626940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] PATH_INFO: `/v3/projects/bec96ba42442479ab53f5d00ac8f1ccd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:51.628096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec96ba42442479ab53f5d00ac8f1ccd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:51.630156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:51.809187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75773043ef6743859329ae16afe18bc0'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:51.809984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75773043ef6743859329ae16afe18bc0'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:51.810631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75773043ef6743859329ae16afe18bc0'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:51.851332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec96ba42442479ab53f5d00ac8f1ccd', 'request_id': 'req-4405d76b-684e-43f1-9eb6-327cf9d66953'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:51.857603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec96ba42442479ab53f5d00ac8f1ccd', 'request_id': 'req-4405d76b-684e-43f1-9eb6-327cf9d66953'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:52.004809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75773043ef6743859329ae16afe18bc0'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:52.017375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e4d96fb0-7221-43b2-85eb-93444e2754d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75773043ef6743859329ae16afe18bc0'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:52.030266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1058/2114] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:51 2022] DELETE /identity/v3/users/75773043ef6743859329ae16afe18bc0 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:52.034697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d64a1e-2b50-4bc3-baa4-c76391668cfa None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:52.034980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d64a1e-2b50-4bc3-baa4-c76391668cfa None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:52.035257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d64a1e-2b50-4bc3-baa4-c76391668cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:52.056465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-89d64a1e-2b50-4bc3-baa4-c76391668cfa None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:52.057724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-89d64a1e-2b50-4bc3-baa4-c76391668cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:52.126498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1059/2115] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:52.136500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d64a1e-2b50-4bc3-baa4-c76391668cfa None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:52.142597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-89d64a1e-2b50-4bc3-baa4-c76391668cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:52.170119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec96ba42442479ab53f5d00ac8f1ccd', 'request_id': 'req-4405d76b-684e-43f1-9eb6-327cf9d66953'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:52.183488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] The token cache is being invalidate because project bec96ba42442479ab53f5d00ac8f1ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:52.184028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:52.184719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-4405d76b-684e-43f1-9eb6-327cf9d66953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:52.186359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1057/2116] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:51 2022] DELETE /identity/v3/projects/bec96ba42442479ab53f5d00ac8f1ccd => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:52.191402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5edeac-c9db-4986-98e7-c7277685095b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:52.191871 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5edeac-c9db-4986-98e7-c7277685095b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:52.192258 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5edeac-c9db-4986-98e7-c7277685095b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:52.205891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d64a1e-2b50-4bc3-baa4-c76391668cfa None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:52.210620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7328-58ca-42dc-9a1e-bc154bf8b835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:52.216556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7328-58ca-42dc-9a1e-bc154bf8b835 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:52.216556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7328-58ca-42dc-9a1e-bc154bf8b835 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:52.216556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7328-58ca-42dc-9a1e-bc154bf8b835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:52.216556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-318e7328-58ca-42dc-9a1e-bc154bf8b835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:52.217137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-aa5edeac-c9db-4986-98e7-c7277685095b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:52.217137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-aa5edeac-c9db-4986-98e7-c7277685095b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:52.226210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1058/2117] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:52.229619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7328-58ca-42dc-9a1e-bc154bf8b835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:52.231252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7328-58ca-42dc-9a1e-bc154bf8b835 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:52.234571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03ae1e-f2ed-4f00-bddc-7acb19344e56 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:52.240649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03ae1e-f2ed-4f00-bddc-7acb19344e56 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:52.240649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03ae1e-f2ed-4f00-bddc-7acb19344e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:52.241400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1060/2118] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:52.264382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3d03ae1e-f2ed-4f00-bddc-7acb19344e56 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:52.264382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3d03ae1e-f2ed-4f00-bddc-7acb19344e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:52.269626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1059/2119] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:52.274597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7328-58ca-42dc-9a1e-bc154bf8b835 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:52.284711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7328-58ca-42dc-9a1e-bc154bf8b835 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:52.289775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5537f53-c781-41bf-ac8d-609592c71d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:52.290380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5537f53-c781-41bf-ac8d-609592c71d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:52.290663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5537f53-c781-41bf-ac8d-609592c71d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:52.290943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5537f53-c781-41bf-ac8d-609592c71d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:52.291642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5537f53-c781-41bf-ac8d-609592c71d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:52.291951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5537f53-c781-41bf-ac8d-609592c71d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:52.293569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5537f53-c781-41bf-ac8d-609592c71d96 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:52.309590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1061/2120] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:52.312651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03ae1e-f2ed-4f00-bddc-7acb19344e56 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:52.323262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03ae1e-f2ed-4f00-bddc-7acb19344e56 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:52.328383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d11d9-8727-4bc3-99e4-8c2047451a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:52.329107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d11d9-8727-4bc3-99e4-8c2047451a4d admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:52.329332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d11d9-8727-4bc3-99e4-8c2047451a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:52.329632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d11d9-8727-4bc3-99e4-8c2047451a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:52.330334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d11d9-8727-4bc3-99e4-8c2047451a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:52.332311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d11d9-8727-4bc3-99e4-8c2047451a4d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:52.544199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1060/2121] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:52 2022] POST /identity/v3/projects => generated 405 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:52.548570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5537f53-c781-41bf-ac8d-609592c71d96 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:52.559083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5537f53-c781-41bf-ac8d-609592c71d96 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:52.653472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b10ed-2a38-4db1-b95c-98cf9fbf18ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:52.654464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b10ed-2a38-4db1-b95c-98cf9fbf18ae admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:52.655241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b10ed-2a38-4db1-b95c-98cf9fbf18ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:52.655241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b10ed-2a38-4db1-b95c-98cf9fbf18ae admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:52.655826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b10ed-2a38-4db1-b95c-98cf9fbf18ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:52.657948 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b10ed-2a38-4db1-b95c-98cf9fbf18ae admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:52.741095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d11d9-8727-4bc3-99e4-8c2047451a4d admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:52.743298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-dc0d11d9-8727-4bc3-99e4-8c2047451a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:52.763362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d11d9-8727-4bc3-99e4-8c2047451a4d admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:52.768728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:52.769411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:52.769721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:52.770009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] PATH_INFO: `/v3/users/d047dc004f924855a58f0b00e26b8cec` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:52.771212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d047dc004f924855a58f0b00e26b8cec)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:52.773714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:52.997197 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1062/2122] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:52 2022] POST /identity/v3/users => generated 303 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:52.998076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b10ed-2a38-4db1-b95c-98cf9fbf18ae admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:53.001926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-096b10ed-2a38-4db1-b95c-98cf9fbf18ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:53.017136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b10ed-2a38-4db1-b95c-98cf9fbf18ae admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:53.023643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:53.024304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.024586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.024862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] PATH_INFO: `/v3/projects/a79fcad5fc99488fb7bd3e1f27d3a96e` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.026152 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79fcad5fc99488fb7bd3e1f27d3a96e)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:53.035793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:53.162454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd047dc004f924855a58f0b00e26b8cec'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:53.212333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:53.229937 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79fcad5fc99488fb7bd3e1f27d3a96e', 'request_id': 'req-76bcb986-d4b3-43b2-910b-aff57b868e1f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:53.237522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79fcad5fc99488fb7bd3e1f27d3a96e', 'request_id': 'req-76bcb986-d4b3-43b2-910b-aff57b868e1f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:53.310407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd047dc004f924855a58f0b00e26b8cec'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:53.311121 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd047dc004f924855a58f0b00e26b8cec'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:53.325995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd047dc004f924855a58f0b00e26b8cec'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:53.326650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd047dc004f924855a58f0b00e26b8cec'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:53.340496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1061/2123] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:52 2022] DELETE /identity/v3/users/d047dc004f924855a58f0b00e26b8cec => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:53.341346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:53.343702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:53.422725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeef5c0-ca2c-47e2-90fa-c9909cfe0e60 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:53.428323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69a128-27ed-43d5-8ab7-ba9129f2a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:53.429061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69a128-27ed-43d5-8ab7-ba9129f2a840 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.429567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69a128-27ed-43d5-8ab7-ba9129f2a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.430063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69a128-27ed-43d5-8ab7-ba9129f2a840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.430742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69a128-27ed-43d5-8ab7-ba9129f2a840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:53.432348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69a128-27ed-43d5-8ab7-ba9129f2a840 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:53.438989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79fcad5fc99488fb7bd3e1f27d3a96e', 'request_id': 'req-76bcb986-d4b3-43b2-910b-aff57b868e1f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:53.444066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1062/2124] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:53.445583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bf0b1-6343-470d-a042-efd99609575b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.449139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bf0b1-6343-470d-a042-efd99609575b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.449139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bf0b1-6343-470d-a042-efd99609575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.455250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] The token cache is being invalidate because project a79fcad5fc99488fb7bd3e1f27d3a96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:53.455567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:53.456272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:53.462539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1063/2125] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:52 2022] DELETE /identity/v3/projects/a79fcad5fc99488fb7bd3e1f27d3a96e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:53.469039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:53.469039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:53.479460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ae0bf0b1-6343-470d-a042-efd99609575b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:53.480794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ae0bf0b1-6343-470d-a042-efd99609575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:53.489743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1063/2126] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:53.491914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653972ff-0001-498b-900d-05fc9f169e21 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.492202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653972ff-0001-498b-900d-05fc9f169e21 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.492483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653972ff-0001-498b-900d-05fc9f169e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.530576 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-653972ff-0001-498b-900d-05fc9f169e21 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:53.531997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-653972ff-0001-498b-900d-05fc9f169e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:53.543487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1064/2127] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:53.544083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653972ff-0001-498b-900d-05fc9f169e21 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:53.545502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-653972ff-0001-498b-900d-05fc9f169e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:53.546721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcb986-d4b3-43b2-910b-aff57b868e1f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:53.555945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358efb9-9d97-4f3c-9e02-633f5cdd7a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:53.556576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358efb9-9d97-4f3c-9e02-633f5cdd7a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.556858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358efb9-9d97-4f3c-9e02-633f5cdd7a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.557134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358efb9-9d97-4f3c-9e02-633f5cdd7a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.557843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358efb9-9d97-4f3c-9e02-633f5cdd7a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:53.561567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358efb9-9d97-4f3c-9e02-633f5cdd7a0e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:53.581874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1064/2128] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:53.583095 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec636-61b8-4419-b6ed-2a39ce108233 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.583383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec636-61b8-4419-b6ed-2a39ce108233 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.583662 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec636-61b8-4419-b6ed-2a39ce108233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.604919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c9aec636-61b8-4419-b6ed-2a39ce108233 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:53.606212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c9aec636-61b8-4419-b6ed-2a39ce108233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:53.616309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1065/2129] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:53.618089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aec636-61b8-4419-b6ed-2a39ce108233 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:53.620473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c9aec636-61b8-4419-b6ed-2a39ce108233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:53.624490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:53.647046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653972ff-0001-498b-900d-05fc9f169e21 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:53.652410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaba944-7e37-47ce-a54c-eb5eb31940de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:53.653120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba944-7e37-47ce-a54c-eb5eb31940de service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.653392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba944-7e37-47ce-a54c-eb5eb31940de service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.653775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaba944-7e37-47ce-a54c-eb5eb31940de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.664579 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaba944-7e37-47ce-a54c-eb5eb31940de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:53.666078 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaba944-7e37-47ce-a54c-eb5eb31940de service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:53.679291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1065/2130] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:53.680127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaba944-7e37-47ce-a54c-eb5eb31940de service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:53.686758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aec636-61b8-4419-b6ed-2a39ce108233 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:53.690225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaba944-7e37-47ce-a54c-eb5eb31940de service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:53.691164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc668-c5d9-4bcd-93e4-bb53925e18be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:53.691790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc668-c5d9-4bcd-93e4-bb53925e18be service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.692072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc668-c5d9-4bcd-93e4-bb53925e18be service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.692349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cc668-c5d9-4bcd-93e4-bb53925e18be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.696630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f82cc668-c5d9-4bcd-93e4-bb53925e18be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:53.707385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c188780-3ce0-4643-923c-273a6dcd2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:53.709554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188780-3ce0-4643-923c-273a6dcd2019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.710696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188780-3ce0-4643-923c-273a6dcd2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.711114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188780-3ce0-4643-923c-273a6dcd2019 admin admin] PATH_INFO: `/v3/projects/783ece6c50ba4114b3ece6c660725ac5/users/86e9445169c44a2ba5251444d7ed0eab/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.733805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c188780-3ce0-4643-923c-273a6dcd2019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783ece6c50ba4114b3ece6c660725ac5, user_id=86e9445169c44a2ba5251444d7ed0eab, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:53.739165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c188780-3ce0-4643-923c-273a6dcd2019 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:53.788295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cc668-c5d9-4bcd-93e4-bb53925e18be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:53.789866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cc668-c5d9-4bcd-93e4-bb53925e18be service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:53.800400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1066/2131] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:53.801217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc668-c5d9-4bcd-93e4-bb53925e18be service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:53.814893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cc668-c5d9-4bcd-93e4-bb53925e18be service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:53.820040 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d989df-f754-4f29-88e9-70b7d260fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:53.820653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d989df-f754-4f29-88e9-70b7d260fd03 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.820930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d989df-f754-4f29-88e9-70b7d260fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.821209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d989df-f754-4f29-88e9-70b7d260fd03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.821958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d989df-f754-4f29-88e9-70b7d260fd03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:53.822412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d989df-f754-4f29-88e9-70b7d260fd03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:53.824024 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d989df-f754-4f29-88e9-70b7d260fd03 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:53.837160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1067/2132] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:53.841457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d989df-f754-4f29-88e9-70b7d260fd03 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:53.852131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d989df-f754-4f29-88e9-70b7d260fd03 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:53.857505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96a55c-a8bb-4482-b1d5-f9c66b2a5495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:53.858117 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96a55c-a8bb-4482-b1d5-f9c66b2a5495 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.858399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96a55c-a8bb-4482-b1d5-f9c66b2a5495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.858674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96a55c-a8bb-4482-b1d5-f9c66b2a5495 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.859421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96a55c-a8bb-4482-b1d5-f9c66b2a5495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:53.861473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96a55c-a8bb-4482-b1d5-f9c66b2a5495 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:53.893547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1066/2133] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:53 2022] PUT /identity/v3/projects/783ece6c50ba4114b3ece6c660725ac5/users/86e9445169c44a2ba5251444d7ed0eab/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:53.901328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd160077-d289-42fd-aead-8859314fc12f None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:53.901616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd160077-d289-42fd-aead-8859314fc12f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:53.901921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd160077-d289-42fd-aead-8859314fc12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:53.940740 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-fd160077-d289-42fd-aead-8859314fc12f None None] MFA Rules not processed for user `86e9445169c44a2ba5251444d7ed0eab`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:53.942717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-fd160077-d289-42fd-aead-8859314fc12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:54.033104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1067/2134] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:54.037865 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1068/2135] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:53 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:54.043217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd160077-d289-42fd-aead-8859314fc12f None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:54.043473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96a55c-a8bb-4482-b1d5-f9c66b2a5495 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:54.136099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd160077-d289-42fd-aead-8859314fc12f None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:54.174801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96a55c-a8bb-4482-b1d5-f9c66b2a5495 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:54.180917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935199-8bd3-4a5f-8d6c-ecb0d344029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:54.181571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935199-8bd3-4a5f-8d6c-ecb0d344029b admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:54.181914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935199-8bd3-4a5f-8d6c-ecb0d344029b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:54.182316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935199-8bd3-4a5f-8d6c-ecb0d344029b admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:54.183001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe935199-8bd3-4a5f-8d6c-ecb0d344029b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:54.184781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe935199-8bd3-4a5f-8d6c-ecb0d344029b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:54.208391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b4f8a-b32c-43b5-be5e-748982807eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:54.209069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b4f8a-b32c-43b5-be5e-748982807eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:54.209607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b4f8a-b32c-43b5-be5e-748982807eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:54.209916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b4f8a-b32c-43b5-be5e-748982807eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:54.210563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b4f8a-b32c-43b5-be5e-748982807eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:54.212485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b4f8a-b32c-43b5-be5e-748982807eb1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:54.338945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1069/2136] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:54 2022] POST /identity/v3/users => generated 284 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:54.340029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935199-8bd3-4a5f-8d6c-ecb0d344029b admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:54.342297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fe935199-8bd3-4a5f-8d6c-ecb0d344029b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:54.358816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935199-8bd3-4a5f-8d6c-ecb0d344029b admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:54.367389 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:54.367917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:54.368187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:54.368590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] PATH_INFO: `/v3/projects/b087134bda4c449dbd1d85929a288594` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:54.369740 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b087134bda4c449dbd1d85929a288594)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:54.372655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:54.409469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1068/2137] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:54 2022] POST /identity/v3/projects => generated 403 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:54.409469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b4f8a-b32c-43b5-be5e-748982807eb1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:54.474985 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b4f8a-b32c-43b5-be5e-748982807eb1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:54.479942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7518eb-4df2-49e3-beb9-d85426471732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:54.480585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7518eb-4df2-49e3-beb9-d85426471732 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:54.480866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7518eb-4df2-49e3-beb9-d85426471732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:54.481139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7518eb-4df2-49e3-beb9-d85426471732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:54.481822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7518eb-4df2-49e3-beb9-d85426471732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:54.483468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7518eb-4df2-49e3-beb9-d85426471732 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:54.494450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1069/2138] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:54.495282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7518eb-4df2-49e3-beb9-d85426471732 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:54.504715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7518eb-4df2-49e3-beb9-d85426471732 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:54.509380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6414-5a53-4348-afd7-0c725254cc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:54.510004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6414-5a53-4348-afd7-0c725254cc33 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:54.510299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6414-5a53-4348-afd7-0c725254cc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:54.510568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6414-5a53-4348-afd7-0c725254cc33 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:54.511208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e6414-5a53-4348-afd7-0c725254cc33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:54.513144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e6414-5a53-4348-afd7-0c725254cc33 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:54.536893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b087134bda4c449dbd1d85929a288594', 'request_id': 'req-52199a37-3b59-4a55-9872-ff4d036cbb4b'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:54.544529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b087134bda4c449dbd1d85929a288594', 'request_id': 'req-52199a37-3b59-4a55-9872-ff4d036cbb4b'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:54.641991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1070/2139] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:54 2022] POST /identity/v3/users => generated 308 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:54.641991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6414-5a53-4348-afd7-0c725254cc33 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:54.649416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6414-5a53-4348-afd7-0c725254cc33 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:54.661422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b087134bda4c449dbd1d85929a288594', 'request_id': 'req-52199a37-3b59-4a55-9872-ff4d036cbb4b'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:54.673398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] The token cache is being invalidate because project b087134bda4c449dbd1d85929a288594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:54.673703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:54.674390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:54.676206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1070/2140] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:54 2022] DELETE /identity/v3/projects/b087134bda4c449dbd1d85929a288594 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:54.676746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:54.678727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:54.715087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc06e3-6a44-465d-9e81-3f1821382b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:54.715700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc06e3-6a44-465d-9e81-3f1821382b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:54.715984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc06e3-6a44-465d-9e81-3f1821382b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:54.716305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc06e3-6a44-465d-9e81-3f1821382b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:54.717305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc06e3-6a44-465d-9e81-3f1821382b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:54.719176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc06e3-6a44-465d-9e81-3f1821382b73 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:54.730866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1071/2141] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:54.733565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc06e3-6a44-465d-9e81-3f1821382b73 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:54.734069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e5dc06e3-6a44-465d-9e81-3f1821382b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:54.746961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52199a37-3b59-4a55-9872-ff4d036cbb4b admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:54.747211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc06e3-6a44-465d-9e81-3f1821382b73 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:54.752449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:54.752653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004b0dc-663a-4540-a096-7ffad2547316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:54.753105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:54.753411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004b0dc-663a-4540-a096-7ffad2547316 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:54.753527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:54.753725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004b0dc-663a-4540-a096-7ffad2547316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:54.753875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] PATH_INFO: `/v3/users/1a851140f9504c0a9dde6aa1126e5b43` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:54.754042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004b0dc-663a-4540-a096-7ffad2547316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:54.754843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004b0dc-663a-4540-a096-7ffad2547316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:54.756536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004b0dc-663a-4540-a096-7ffad2547316 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:54.757143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a851140f9504c0a9dde6aa1126e5b43)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:54.759194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:54.771773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1071/2142] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:54.771773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004b0dc-663a-4540-a096-7ffad2547316 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:54.772707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e004b0dc-663a-4540-a096-7ffad2547316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:54.794589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004b0dc-663a-4540-a096-7ffad2547316 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:54.801774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c8114-5be8-4d96-8b8b-fb21e912f56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:54.813837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c8114-5be8-4d96-8b8b-fb21e912f56f admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:54.813837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c8114-5be8-4d96-8b8b-fb21e912f56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:54.813837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c8114-5be8-4d96-8b8b-fb21e912f56f admin admin] PATH_INFO: `/v3/projects/61610fa0bb6245e4b4ce4698e46abf55/users/829c6d3ee8c646608325b3a5b66af6de/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:54.821048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c8114-5be8-4d96-8b8b-fb21e912f56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61610fa0bb6245e4b4ce4698e46abf55, user_id=829c6d3ee8c646608325b3a5b66af6de, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:54.824405 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c8114-5be8-4d96-8b8b-fb21e912f56f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:54.955388 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1072/2143] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:54 2022] PUT /identity/v3/projects/61610fa0bb6245e4b4ce4698e46abf55/users/829c6d3ee8c646608325b3a5b66af6de/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:54.956187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c8114-5be8-4d96-8b8b-fb21e912f56f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:55.016984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c8114-5be8-4d96-8b8b-fb21e912f56f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:55.022379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6e2eb-e83c-4914-b812-9c488e843e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:55.023035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e2eb-e83c-4914-b812-9c488e843e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:55.023317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e2eb-e83c-4914-b812-9c488e843e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:55.023656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e2eb-e83c-4914-b812-9c488e843e38 admin admin] PATH_INFO: `/v3/projects/8d59ad8d1d0f4476a3c2efe01ec8f9a1/users/638d8eb6d0784db78fee3593c7bb9cc9/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:55.039617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6e2eb-e83c-4914-b812-9c488e843e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d59ad8d1d0f4476a3c2efe01ec8f9a1, user_id=638d8eb6d0784db78fee3593c7bb9cc9, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:55.042416 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6e2eb-e83c-4914-b812-9c488e843e38 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:55.052554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a851140f9504c0a9dde6aa1126e5b43'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:55.150539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a851140f9504c0a9dde6aa1126e5b43'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:55.151458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a851140f9504c0a9dde6aa1126e5b43'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:55.158224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1073/2144] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:54 2022] PUT /identity/v3/projects/8d59ad8d1d0f4476a3c2efe01ec8f9a1/users/638d8eb6d0784db78fee3593c7bb9cc9/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:55.163248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a70a4-c2ab-447f-b37b-47db5203dd4b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:55.163540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a70a4-c2ab-447f-b37b-47db5203dd4b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:55.163819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a70a4-c2ab-447f-b37b-47db5203dd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:55.169004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a851140f9504c0a9dde6aa1126e5b43'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:55.169867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a851140f9504c0a9dde6aa1126e5b43'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:55.190059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1072/2145] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:54 2022] DELETE /identity/v3/users/1a851140f9504c0a9dde6aa1126e5b43 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:55.190059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:55.195018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:55.287021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-7e6a70a4-c2ab-447f-b37b-47db5203dd4b None None] MFA Rules not processed for user `829c6d3ee8c646608325b3a5b66af6de`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:55.290245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7e6a70a4-c2ab-447f-b37b-47db5203dd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:55.313594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa119-299c-4e7f-a10f-9b9fd066d98d admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:55.320658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912832-dbd2-459e-8d86-2eea18b5ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:55.321423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912832-dbd2-459e-8d86-2eea18b5ca47 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:55.321744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912832-dbd2-459e-8d86-2eea18b5ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:55.322023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912832-dbd2-459e-8d86-2eea18b5ca47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:55.322694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8912832-dbd2-459e-8d86-2eea18b5ca47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:55.324789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8912832-dbd2-459e-8d86-2eea18b5ca47 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:55.340304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1073/2146] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:55.345788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:55.355550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912832-dbd2-459e-8d86-2eea18b5ca47 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:55.360937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912832-dbd2-459e-8d86-2eea18b5ca47 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:55.371346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ef4a1-7ea4-4c12-863b-185d2bb154a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:55.372548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ef4a1-7ea4-4c12-863b-185d2bb154a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:55.373032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ef4a1-7ea4-4c12-863b-185d2bb154a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:55.373454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ef4a1-7ea4-4c12-863b-185d2bb154a6 admin admin] PATH_INFO: `/v3/projects/8d59ad8d1d0f4476a3c2efe01ec8f9a1/users/638d8eb6d0784db78fee3593c7bb9cc9/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:55.376311 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ef4a1-7ea4-4c12-863b-185d2bb154a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d59ad8d1d0f4476a3c2efe01ec8f9a1, user_id=638d8eb6d0784db78fee3593c7bb9cc9, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:55.380620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ef4a1-7ea4-4c12-863b-185d2bb154a6 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:55.394355 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1074/2147] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:55 2022] PUT /identity/v3/projects/8d59ad8d1d0f4476a3c2efe01ec8f9a1/users/638d8eb6d0784db78fee3593c7bb9cc9/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:55.406278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343be23-335d-4728-b89f-9a87e520ecbe None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:55.406594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343be23-335d-4728-b89f-9a87e520ecbe None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:55.406943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343be23-335d-4728-b89f-9a87e520ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:55.424179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1074/2148] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:55.434717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a70a4-c2ab-447f-b37b-47db5203dd4b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:55.436104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7e6a70a4-c2ab-447f-b37b-47db5203dd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:55.439152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4343be23-335d-4728-b89f-9a87e520ecbe None None] MFA Rules not processed for user `638d8eb6d0784db78fee3593c7bb9cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:55.440451 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4343be23-335d-4728-b89f-9a87e520ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:55.515112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1075/2149] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:29:55.529962 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343be23-335d-4728-b89f-9a87e520ecbe None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:55.530521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a70a4-c2ab-447f-b37b-47db5203dd4b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:55.531847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4343be23-335d-4728-b89f-9a87e520ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:55.601320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df55899-6337-41e3-bfa1-62375cc6d32b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f14e5614aee44c59a47b12e5b35ea3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:55.601974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df55899-6337-41e3-bfa1-62375cc6d32b service glance] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:55.602265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df55899-6337-41e3-bfa1-62375cc6d32b service glance] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:55.608793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df55899-6337-41e3-bfa1-62375cc6d32b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:55.608921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343be23-335d-4728-b89f-9a87e520ecbe None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:55.608921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c3a54-b11c-40d0-a9c4-5575353b73bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:55.609127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3a54-b11c-40d0-a9c4-5575353b73bc service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:55.609327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3a54-b11c-40d0-a9c4-5575353b73bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:55.609603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c3a54-b11c-40d0-a9c4-5575353b73bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:55.620392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c3a54-b11c-40d0-a9c4-5575353b73bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:55.621911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c3a54-b11c-40d0-a9c4-5575353b73bc service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:55.633748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1076/2150] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:55 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:55.675908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df55899-6337-41e3-bfa1-62375cc6d32b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:55.680979 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df55899-6337-41e3-bfa1-62375cc6d32b service glance] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:55.695452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1075/2151] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:55.816733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:55.826511 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c3a54-b11c-40d0-a9c4-5575353b73bc service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:55.828126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d93c3a54-b11c-40d0-a9c4-5575353b73bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:55.943150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c3a54-b11c-40d0-a9c4-5575353b73bc service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:55.948533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:55.949269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:55.949553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:55.949859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] PATH_INFO: `/v3/projects/dbcfa7803ce446ffa4669d1b37833f19` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:55.950988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbcfa7803ce446ffa4669d1b37833f19)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:55.952896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:56.080797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbcfa7803ce446ffa4669d1b37833f19', 'request_id': 'req-865aec66-da2d-4bef-a6cb-070bf7d84590'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.088484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbcfa7803ce446ffa4669d1b37833f19', 'request_id': 'req-865aec66-da2d-4bef-a6cb-070bf7d84590'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.099296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df55899-6337-41e3-bfa1-62375cc6d32b service glance] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:56.112884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df55899-6337-41e3-bfa1-62375cc6d32b service glance] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:56.179742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:56.180207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:56.180487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:56.180780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] PATH_INFO: `/v3/users/86e9445169c44a2ba5251444d7ed0eab` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:56.181945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e9445169c44a2ba5251444d7ed0eab)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:56.184017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:56.219485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbcfa7803ce446ffa4669d1b37833f19', 'request_id': 'req-865aec66-da2d-4bef-a6cb-070bf7d84590'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.235005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] The token cache is being invalidate because project dbcfa7803ce446ffa4669d1b37833f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:56.235298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.236013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.241463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1077/2152] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:55 2022] DELETE /identity/v3/projects/dbcfa7803ce446ffa4669d1b37833f19 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:56.242501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:56.243961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:56.257119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aec66-da2d-4bef-a6cb-070bf7d84590 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:56.261843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:56.262481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:56.262767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:56.263046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] PATH_INFO: `/v3/users/c5e452e8294446cd9b681c83a180d037` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:56.264178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e452e8294446cd9b681c83a180d037)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:56.266147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:56.570826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e452e8294446cd9b681c83a180d037'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.585637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e9445169c44a2ba5251444d7ed0eab'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.586411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e9445169c44a2ba5251444d7ed0eab'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.587084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e9445169c44a2ba5251444d7ed0eab'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.879158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e452e8294446cd9b681c83a180d037'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.879396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e9445169c44a2ba5251444d7ed0eab'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.880050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e452e8294446cd9b681c83a180d037'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.894618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e9445169c44a2ba5251444d7ed0eab'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.897089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e452e8294446cd9b681c83a180d037'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.897925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-1ebde8cb-9a4f-4d1e-aeb2-eaa6b5be59e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e452e8294446cd9b681c83a180d037'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:56.908206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1076/2153] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:56 2022] DELETE /identity/v3/users/86e9445169c44a2ba5251444d7ed0eab => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:56.908969 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:56.910360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:56.911375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1078/2154] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:56 2022] DELETE /identity/v3/users/c5e452e8294446cd9b681c83a180d037 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:56.912747 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aea61c-69f0-4d2e-8f1e-8525a4d850ec None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:56.913196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aea61c-69f0-4d2e-8f1e-8525a4d850ec None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:56.913481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aea61c-69f0-4d2e-8f1e-8525a4d850ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:56.932686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-95aea61c-69f0-4d2e-8f1e-8525a4d850ec None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:56.933979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-95aea61c-69f0-4d2e-8f1e-8525a4d850ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:56.982364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a27a0c-f43e-4763-bdf1-e6d704d6a5ff admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:57.004544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1079/2155] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:57.006390 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0f87-6278-4a12-b19b-99a2bdaa4922 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:57.006790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0f87-6278-4a12-b19b-99a2bdaa4922 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:57.007076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0f87-6278-4a12-b19b-99a2bdaa4922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:57.027676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-1e3b0f87-6278-4a12-b19b-99a2bdaa4922 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:57.045824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1e3b0f87-6278-4a12-b19b-99a2bdaa4922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:57.045824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1080/2156] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:57.045824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b0f87-6278-4a12-b19b-99a2bdaa4922 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:57.045824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1e3b0f87-6278-4a12-b19b-99a2bdaa4922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:57.054790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:57.055443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:57.055735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:57.056015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] PATH_INFO: `/v3/users/ada62513bec54142b14b79afadc04dc2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:57.057702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada62513bec54142b14b79afadc04dc2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:57.059674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:57.115101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b0f87-6278-4a12-b19b-99a2bdaa4922 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:57.119660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f2374-638c-4bca-bed0-09ec72d950a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:57.120284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f2374-638c-4bca-bed0-09ec72d950a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:57.120564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f2374-638c-4bca-bed0-09ec72d950a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:57.120844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f2374-638c-4bca-bed0-09ec72d950a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:57.130676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f2374-638c-4bca-bed0-09ec72d950a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:57.132766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f2374-638c-4bca-bed0-09ec72d950a7 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:57.142829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1081/2157] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:57.143653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f2374-638c-4bca-bed0-09ec72d950a7 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:57.144961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ed9f2374-638c-4bca-bed0-09ec72d950a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:57.158877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f2374-638c-4bca-bed0-09ec72d950a7 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:57.164742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1bf7d-590a-456d-a46b-71c786a86da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:57.165366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1bf7d-590a-456d-a46b-71c786a86da7 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:57.165650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1bf7d-590a-456d-a46b-71c786a86da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:57.165966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1bf7d-590a-456d-a46b-71c786a86da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:57.180186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1bf7d-590a-456d-a46b-71c786a86da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:57.182073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1bf7d-590a-456d-a46b-71c786a86da7 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:57.196716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1082/2158] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:57.282275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada62513bec54142b14b79afadc04dc2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:57.283063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada62513bec54142b14b79afadc04dc2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:57.283739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada62513bec54142b14b79afadc04dc2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:57.367374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada62513bec54142b14b79afadc04dc2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:57.382209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada62513bec54142b14b79afadc04dc2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:57.397087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1077/2159] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:56 2022] DELETE /identity/v3/users/ada62513bec54142b14b79afadc04dc2 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:57.912989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1bf7d-590a-456d-a46b-71c786a86da7 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:57.914547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4fc1bf7d-590a-456d-a46b-71c786a86da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:57.921650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:57.923161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:57.965375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1bf7d-590a-456d-a46b-71c786a86da7 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.011397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ae3d2-bc77-46e3-93e8-e2cda8a9e245 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.019954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.021097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.021563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.022090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] PATH_INFO: `/v3/projects/783ece6c50ba4114b3ece6c660725ac5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.023808 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=783ece6c50ba4114b3ece6c660725ac5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.027517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.064896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.065548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.065877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.066154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] PATH_INFO: `/v3/projects/93e22d68b37e4ae0842cb1f494ae8cf3` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.067321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e22d68b37e4ae0842cb1f494ae8cf3)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.069999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.273078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783ece6c50ba4114b3ece6c660725ac5', 'request_id': 'req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.276201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e22d68b37e4ae0842cb1f494ae8cf3', 'request_id': 'req-270a5968-8bd1-46ef-925e-60be82893f13'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.281144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783ece6c50ba4114b3ece6c660725ac5', 'request_id': 'req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.293593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e22d68b37e4ae0842cb1f494ae8cf3', 'request_id': 'req-270a5968-8bd1-46ef-925e-60be82893f13'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.407045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783ece6c50ba4114b3ece6c660725ac5', 'request_id': 'req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.422909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] The token cache is being invalidate because project 783ece6c50ba4114b3ece6c660725ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:58.423421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.424458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.426914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1078/2160] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:57 2022] DELETE /identity/v3/projects/783ece6c50ba4114b3ece6c660725ac5 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:58.428478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:58.430191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:58.485237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e22d68b37e4ae0842cb1f494ae8cf3', 'request_id': 'req-270a5968-8bd1-46ef-925e-60be82893f13'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.507834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] The token cache is being invalidate because project 93e22d68b37e4ae0842cb1f494ae8cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:58.508928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.513278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.515732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1083/2161] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:57 2022] DELETE /identity/v3/projects/93e22d68b37e4ae0842cb1f494ae8cf3 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:58.518354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c3e9a-0392-4d9e-b24e-1fdab5ddb6de admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.520232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:58.522703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:58.607928 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.609430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.610356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.611038 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] PATH_INFO: `/v3/projects/716c7abebe8b4a02a75ba0acfc87a31c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.613054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] RBAC: Authorizing `identity:delete_project(project_id=716c7abebe8b4a02a75ba0acfc87a31c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.616455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.622970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a5968-8bd1-46ef-925e-60be82893f13 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.644065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.644760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.645012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.645289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] PATH_INFO: `/v3/users/638d8eb6d0784db78fee3593c7bb9cc9` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.647236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=638d8eb6d0784db78fee3593c7bb9cc9)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.649175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.664251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:58.863270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '716c7abebe8b4a02a75ba0acfc87a31c', 'request_id': 'req-d66f5a96-9fed-426c-bf70-b66da01fccac'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.875114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '716c7abebe8b4a02a75ba0acfc87a31c', 'request_id': 'req-d66f5a96-9fed-426c-bf70-b66da01fccac'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:59.030851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '716c7abebe8b4a02a75ba0acfc87a31c', 'request_id': 'req-d66f5a96-9fed-426c-bf70-b66da01fccac'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:59.044475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] The token cache is being invalidate because project 716c7abebe8b4a02a75ba0acfc87a31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:59.066745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:59.066745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d66f5a96-9fed-426c-bf70-b66da01fccac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:59.066745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1079/2162] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:58 2022] DELETE /identity/v3/projects/716c7abebe8b4a02a75ba0acfc87a31c => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:59.066745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ee847-2eb5-4dd1-9e50-9438cfc2bd36 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.066745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ee847-2eb5-4dd1-9e50-9438cfc2bd36 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.066745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ee847-2eb5-4dd1-9e50-9438cfc2bd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.071676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e53ee847-2eb5-4dd1-9e50-9438cfc2bd36 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:59.072956 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e53ee847-2eb5-4dd1-9e50-9438cfc2bd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.146037 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638d8eb6d0784db78fee3593c7bb9cc9'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:59.152561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1080/2163] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:59.154029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aa9a7-b2da-4a5e-a236-ed36a5a21ac1 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.154315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aa9a7-b2da-4a5e-a236-ed36a5a21ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.154590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aa9a7-b2da-4a5e-a236-ed36a5a21ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.175288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-247aa9a7-b2da-4a5e-a236-ed36a5a21ac1 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:59.176586 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-247aa9a7-b2da-4a5e-a236-ed36a5a21ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.189588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1081/2164] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:59.189588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc696-3916-4898-80ae-1a20e8f777c5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.189588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc696-3916-4898-80ae-1a20e8f777c5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.193060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc696-3916-4898-80ae-1a20e8f777c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.215892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-845bc696-3916-4898-80ae-1a20e8f777c5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:59.220275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-845bc696-3916-4898-80ae-1a20e8f777c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.232325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1082/2165] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:59.234881 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4cfa-ccde-4489-b2a2-d8b4b34145f2 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.235288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4cfa-ccde-4489-b2a2-d8b4b34145f2 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.235792 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4cfa-ccde-4489-b2a2-d8b4b34145f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.267344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638d8eb6d0784db78fee3593c7bb9cc9'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:59.272525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638d8eb6d0784db78fee3593c7bb9cc9'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:59.274716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5f5a4cfa-ccde-4489-b2a2-d8b4b34145f2 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:59.276110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5f5a4cfa-ccde-4489-b2a2-d8b4b34145f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.283610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638d8eb6d0784db78fee3593c7bb9cc9'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:59.284334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638d8eb6d0784db78fee3593c7bb9cc9'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:59.284681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1083/2166] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:59.285526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4cfa-ccde-4489-b2a2-d8b4b34145f2 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.298773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4cfa-ccde-4489-b2a2-d8b4b34145f2 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.305983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbf952-5c3a-4b06-a290-6065901e96d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.306951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbf952-5c3a-4b06-a290-6065901e96d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.307087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1084/2167] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:58 2022] DELETE /identity/v3/users/638d8eb6d0784db78fee3593c7bb9cc9 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:59.307414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbf952-5c3a-4b06-a290-6065901e96d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.307898 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbf952-5c3a-4b06-a290-6065901e96d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.309056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbf952-5c3a-4b06-a290-6065901e96d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:59.309604 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbf952-5c3a-4b06-a290-6065901e96d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.312636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbf952-5c3a-4b06-a290-6065901e96d9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.313197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.315601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.336747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1084/2168] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:59.348466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbf952-5c3a-4b06-a290-6065901e96d9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.350869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-05dbf952-5c3a-4b06-a290-6065901e96d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.366714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbf952-5c3a-4b06-a290-6065901e96d9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.412854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836743c-64d5-4c9e-a812-7e68d8e5e979 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.415289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:59.418274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ca3b1-cf61-4a97-9246-a869a1f858ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.419103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ca3b1-cf61-4a97-9246-a869a1f858ab admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.419444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ca3b1-cf61-4a97-9246-a869a1f858ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.419988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ca3b1-cf61-4a97-9246-a869a1f858ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.421266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ca3b1-cf61-4a97-9246-a869a1f858ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:59.422044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ca3b1-cf61-4a97-9246-a869a1f858ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.425505 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ca3b1-cf61-4a97-9246-a869a1f858ab admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.444296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1085/2169] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:29:59.445855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ca3b1-cf61-4a97-9246-a869a1f858ab admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.456756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6329674-923f-4e08-91ef-40d49254c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.457626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6329674-923f-4e08-91ef-40d49254c05a admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.466771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6329674-923f-4e08-91ef-40d49254c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.466771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6329674-923f-4e08-91ef-40d49254c05a admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.467096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ca3b1-cf61-4a97-9246-a869a1f858ab admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.467202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6329674-923f-4e08-91ef-40d49254c05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.467202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6329674-923f-4e08-91ef-40d49254c05a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.467366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0350ac-4e43-41a2-97aa-299b3bad5e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.467366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0350ac-4e43-41a2-97aa-299b3bad5e2c admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.467366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0350ac-4e43-41a2-97aa-299b3bad5e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.467366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0350ac-4e43-41a2-97aa-299b3bad5e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.467865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0350ac-4e43-41a2-97aa-299b3bad5e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.470079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0350ac-4e43-41a2-97aa-299b3bad5e2c admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.628398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1085/2170] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:59 2022] POST /identity/v3/projects => generated 375 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:59.633596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6329674-923f-4e08-91ef-40d49254c05a admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.638493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1086/2171] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:59 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:59.640381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0350ac-4e43-41a2-97aa-299b3bad5e2c admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.732206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6329674-923f-4e08-91ef-40d49254c05a admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.733728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0350ac-4e43-41a2-97aa-299b3bad5e2c admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.739331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424254f-9add-49e8-81b9-8a582944be9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.739633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70f6a8-0beb-4722-8451-1704de7a3938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.740356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f6a8-0beb-4722-8451-1704de7a3938 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.741123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f6a8-0beb-4722-8451-1704de7a3938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.741245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424254f-9add-49e8-81b9-8a582944be9f admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.741402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f6a8-0beb-4722-8451-1704de7a3938 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.741532 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424254f-9add-49e8-81b9-8a582944be9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.741739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424254f-9add-49e8-81b9-8a582944be9f admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.742086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70f6a8-0beb-4722-8451-1704de7a3938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.742380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424254f-9add-49e8-81b9-8a582944be9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.744052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70f6a8-0beb-4722-8451-1704de7a3938 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.744498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424254f-9add-49e8-81b9-8a582944be9f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.914713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1086/2172] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:59 2022] POST /identity/v3/users => generated 288 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:59.915274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1087/2173] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:59 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:59.918528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424254f-9add-49e8-81b9-8a582944be9f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.919448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70f6a8-0beb-4722-8451-1704de7a3938 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.930765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70f6a8-0beb-4722-8451-1704de7a3938 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.933011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424254f-9add-49e8-81b9-8a582944be9f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.936354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5407e-ebd3-4548-ad61-255b593c1c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.936981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5407e-ebd3-4548-ad61-255b593c1c31 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.937270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5407e-ebd3-4548-ad61-255b593c1c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.938286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5407e-ebd3-4548-ad61-255b593c1c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.938286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5407e-ebd3-4548-ad61-255b593c1c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.940279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5407e-ebd3-4548-ad61-255b593c1c31 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.941994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb87759-c850-4ebf-b094-d2be578bf8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.942683 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb87759-c850-4ebf-b094-d2be578bf8df admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.942958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb87759-c850-4ebf-b094-d2be578bf8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.943255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb87759-c850-4ebf-b094-d2be578bf8df admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.944541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb87759-c850-4ebf-b094-d2be578bf8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.945729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb87759-c850-4ebf-b094-d2be578bf8df admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.952146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1088/2174] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:59.962371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5407e-ebd3-4548-ad61-255b593c1c31 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.967302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1087/2175] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:59.970944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb87759-c850-4ebf-b094-d2be578bf8df admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.974170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5407e-ebd3-4548-ad61-255b593c1c31 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.980999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbe959-9770-4406-b4f9-9ebafe533636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.981634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbe959-9770-4406-b4f9-9ebafe533636 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.981973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbe959-9770-4406-b4f9-9ebafe533636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.982258 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbe959-9770-4406-b4f9-9ebafe533636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.983122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbe959-9770-4406-b4f9-9ebafe533636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.985171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbe959-9770-4406-b4f9-9ebafe533636 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.985330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb87759-c850-4ebf-b094-d2be578bf8df admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.992490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9039-fe78-412b-ae7f-b21367849518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.992490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9039-fe78-412b-ae7f-b21367849518 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.992490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9039-fe78-412b-ae7f-b21367849518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.992490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9039-fe78-412b-ae7f-b21367849518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.993172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a9039-fe78-412b-ae7f-b21367849518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.994427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a9039-fe78-412b-ae7f-b21367849518 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:00.003111 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1089/2176] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:00.006180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbe959-9770-4406-b4f9-9ebafe533636 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:00.011281 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1088/2177] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:00.015218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9039-fe78-412b-ae7f-b21367849518 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:00.016907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbe959-9770-4406-b4f9-9ebafe533636 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:00.026229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9039-fe78-412b-ae7f-b21367849518 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:00.030333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22cc11-c5fd-46fe-89fc-0416f2e80dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:00.035850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22cc11-c5fd-46fe-89fc-0416f2e80dba admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:00.036940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d44a6-d4d4-4424-8c55-6e12f880dbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:00.038192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22cc11-c5fd-46fe-89fc-0416f2e80dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:00.038192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22cc11-c5fd-46fe-89fc-0416f2e80dba admin admin] PATH_INFO: `/v3/projects/3c27d043b6a64784a04e4461cd1fb5a4/users/c16f1b7950084e3eae38c7c45c19e2cf/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:00.038415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d44a6-d4d4-4424-8c55-6e12f880dbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:00.038415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d44a6-d4d4-4424-8c55-6e12f880dbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:00.038415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d44a6-d4d4-4424-8c55-6e12f880dbd6 admin admin] PATH_INFO: `/v3/projects/793eb1ecaf7945b3ba9d46234321208b/users/d8e19e0752ad420ab0747610fc60a6d7/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:00.053433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22cc11-c5fd-46fe-89fc-0416f2e80dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c27d043b6a64784a04e4461cd1fb5a4, user_id=c16f1b7950084e3eae38c7c45c19e2cf, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:00.056428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22cc11-c5fd-46fe-89fc-0416f2e80dba admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:00.061109 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d44a6-d4d4-4424-8c55-6e12f880dbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793eb1ecaf7945b3ba9d46234321208b, user_id=d8e19e0752ad420ab0747610fc60a6d7, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:00.065608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d44a6-d4d4-4424-8c55-6e12f880dbd6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:00.464754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1090/2178] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:00 2022] PUT /identity/v3/projects/3c27d043b6a64784a04e4461cd1fb5a4/users/c16f1b7950084e3eae38c7c45c19e2cf/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:30:00.464754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22cc11-c5fd-46fe-89fc-0416f2e80dba admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:00.470223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1a22cc11-c5fd-46fe-89fc-0416f2e80dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:00.517550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1089/2179] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:00 2022] PUT /identity/v3/projects/793eb1ecaf7945b3ba9d46234321208b/users/d8e19e0752ad420ab0747610fc60a6d7/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:30:00.527822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d44a6-d4d4-4424-8c55-6e12f880dbd6 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:00.529288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-059d44a6-d4d4-4424-8c55-6e12f880dbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:00.554292 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22cc11-c5fd-46fe-89fc-0416f2e80dba admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:00.602517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d44a6-d4d4-4424-8c55-6e12f880dbd6 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:00.607591 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:00.608229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:00.608509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:00.608784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] PATH_INFO: `/v3/projects/8d59ad8d1d0f4476a3c2efe01ec8f9a1` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:00.609953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d59ad8d1d0f4476a3c2efe01ec8f9a1)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:00.611914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:00.616601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:00.617233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:00.617514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:00.617927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] PATH_INFO: `/v3/users/51d13ab305dc4baba7532d3c6b174990` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:00.619105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d13ab305dc4baba7532d3c6b174990)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:00.621049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:01.083300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d13ab305dc4baba7532d3c6b174990'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:01.099021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d59ad8d1d0f4476a3c2efe01ec8f9a1', 'request_id': 'req-9286c5fc-4921-4a61-913f-842a4b5d1876'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:01.107777 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d59ad8d1d0f4476a3c2efe01ec8f9a1', 'request_id': 'req-9286c5fc-4921-4a61-913f-842a4b5d1876'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:01.201426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d13ab305dc4baba7532d3c6b174990'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:01.202116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d13ab305dc4baba7532d3c6b174990'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:01.218782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d13ab305dc4baba7532d3c6b174990'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:01.219564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d759a592-9986-4449-a2d8-46e973298ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d13ab305dc4baba7532d3c6b174990'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:01.236828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1091/2180] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:00 2022] DELETE /identity/v3/users/51d13ab305dc4baba7532d3c6b174990 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:01.238929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e05b4-2b7b-4eb9-b377-341f940e9c7d None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.239409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e05b4-2b7b-4eb9-b377-341f940e9c7d None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.240068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e05b4-2b7b-4eb9-b377-341f940e9c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.285149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-603e05b4-2b7b-4eb9-b377-341f940e9c7d None None] MFA Rules not processed for user `c16f1b7950084e3eae38c7c45c19e2cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:01.287525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-603e05b4-2b7b-4eb9-b377-341f940e9c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:01.293751 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d59ad8d1d0f4476a3c2efe01ec8f9a1', 'request_id': 'req-9286c5fc-4921-4a61-913f-842a4b5d1876'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:01.309214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] The token cache is being invalidate because project 8d59ad8d1d0f4476a3c2efe01ec8f9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:01.309644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:01.310466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9286c5fc-4921-4a61-913f-842a4b5d1876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:01.312575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1090/2181] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:00 2022] DELETE /identity/v3/projects/8d59ad8d1d0f4476a3c2efe01ec8f9a1 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:01.320069 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cda765-c821-426c-9f1e-aad7b77ff3e3 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.320549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cda765-c821-426c-9f1e-aad7b77ff3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.321023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cda765-c821-426c-9f1e-aad7b77ff3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.376630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-25cda765-c821-426c-9f1e-aad7b77ff3e3 None None] MFA Rules not processed for user `d8e19e0752ad420ab0747610fc60a6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:01.379057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-25cda765-c821-426c-9f1e-aad7b77ff3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:01.410775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1092/2182] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:01.412716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3089f7-808a-4970-94b5-f60c3f3887fe None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.415468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3089f7-808a-4970-94b5-f60c3f3887fe None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.415781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3089f7-808a-4970-94b5-f60c3f3887fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.467343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4f3089f7-808a-4970-94b5-f60c3f3887fe None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:01.468696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4f3089f7-808a-4970-94b5-f60c3f3887fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:01.509019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1091/2183] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:01.510957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70899-3f87-4f31-90fd-7acc94b05881 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.510957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70899-3f87-4f31-90fd-7acc94b05881 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.510957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70899-3f87-4f31-90fd-7acc94b05881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.538924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1093/2184] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:01.539938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3089f7-808a-4970-94b5-f60c3f3887fe None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:01.541341 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4f3089f7-808a-4970-94b5-f60c3f3887fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:01.552342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-0fc70899-3f87-4f31-90fd-7acc94b05881 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:01.554782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0fc70899-3f87-4f31-90fd-7acc94b05881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:01.571153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1092/2185] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:01.571153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc70899-3f87-4f31-90fd-7acc94b05881 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:01.571153 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0fc70899-3f87-4f31-90fd-7acc94b05881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:01.636352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:01.644336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3089f7-808a-4970-94b5-f60c3f3887fe None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:01.650995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5251bb5-464d-4309-bf52-d5c77020d18e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:01.652522 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251bb5-464d-4309-bf52-d5c77020d18e service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.653200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251bb5-464d-4309-bf52-d5c77020d18e service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.653734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5251bb5-464d-4309-bf52-d5c77020d18e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.659410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc70899-3f87-4f31-90fd-7acc94b05881 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:01.664622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6f057-97d7-4065-bced-31a7baf71375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:01.668045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6f057-97d7-4065-bced-31a7baf71375 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.668642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6f057-97d7-4065-bced-31a7baf71375 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.669170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6f057-97d7-4065-bced-31a7baf71375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.671766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5251bb5-464d-4309-bf52-d5c77020d18e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:01.674225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5251bb5-464d-4309-bf52-d5c77020d18e service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:01.681519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6f057-97d7-4065-bced-31a7baf71375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:01.698879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6f057-97d7-4065-bced-31a7baf71375 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:01.699942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1094/2186] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:01.699942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5251bb5-464d-4309-bf52-d5c77020d18e service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:01.699942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f5251bb5-464d-4309-bf52-d5c77020d18e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:01.701214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1093/2187] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:01.703030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f55d-4a6f-4326-802d-a1e6870017ff None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.703521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f55d-4a6f-4326-802d-a1e6870017ff None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.704003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f55d-4a6f-4326-802d-a1e6870017ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.735625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9317f55d-4a6f-4326-802d-a1e6870017ff None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:01.736954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9317f55d-4a6f-4326-802d-a1e6870017ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:01.749195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1094/2188] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:01.752089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f55d-4a6f-4326-802d-a1e6870017ff None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:01.752089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9317f55d-4a6f-4326-802d-a1e6870017ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:01.776551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f55d-4a6f-4326-802d-a1e6870017ff None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:01.782062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:01.782733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.783010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.783290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] PATH_INFO: `/v3/users/c16f1b7950084e3eae38c7c45c19e2cf` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.784481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16f1b7950084e3eae38c7c45c19e2cf)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:01.786470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:01.803641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5251bb5-464d-4309-bf52-d5c77020d18e service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:01.816857 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12668982-c5e6-47c7-9d23-4b767b0534a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:01.818035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12668982-c5e6-47c7-9d23-4b767b0534a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.818601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12668982-c5e6-47c7-9d23-4b767b0534a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.819034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12668982-c5e6-47c7-9d23-4b767b0534a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.835042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12668982-c5e6-47c7-9d23-4b767b0534a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:01.837025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12668982-c5e6-47c7-9d23-4b767b0534a4 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:01.849321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1095/2189] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:01.851203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12668982-c5e6-47c7-9d23-4b767b0534a4 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:01.865421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12668982-c5e6-47c7-9d23-4b767b0534a4 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:01.870814 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c53fd-496c-4a5c-b3fa-83e7e5ef5d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:01.871521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c53fd-496c-4a5c-b3fa-83e7e5ef5d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.871875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c53fd-496c-4a5c-b3fa-83e7e5ef5d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.872237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c53fd-496c-4a5c-b3fa-83e7e5ef5d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.872967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c53fd-496c-4a5c-b3fa-83e7e5ef5d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:30:01.873381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c53fd-496c-4a5c-b3fa-83e7e5ef5d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:01.878072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c53fd-496c-4a5c-b3fa-83e7e5ef5d77 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:01.899168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1096/2190] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:30:01.905139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c53fd-496c-4a5c-b3fa-83e7e5ef5d77 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:01.919702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c53fd-496c-4a5c-b3fa-83e7e5ef5d77 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:01.925629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22136290-1b3c-4059-93ca-733e316606d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:01.926393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136290-1b3c-4059-93ca-733e316606d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:01.926673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136290-1b3c-4059-93ca-733e316606d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:01.926954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136290-1b3c-4059-93ca-733e316606d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:01.927621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22136290-1b3c-4059-93ca-733e316606d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:01.929700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22136290-1b3c-4059-93ca-733e316606d4 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:02.020585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16f1b7950084e3eae38c7c45c19e2cf'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:02.022658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16f1b7950084e3eae38c7c45c19e2cf'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:02.023655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16f1b7950084e3eae38c7c45c19e2cf'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:02.087571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1097/2191] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:01 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:30:02.092801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22136290-1b3c-4059-93ca-733e316606d4 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:02.094646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-22136290-1b3c-4059-93ca-733e316606d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:02.126796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16f1b7950084e3eae38c7c45c19e2cf'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:02.164499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-37bd8014-6009-49d6-91b8-4c70dc9f52e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16f1b7950084e3eae38c7c45c19e2cf'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:02.186586 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22136290-1b3c-4059-93ca-733e316606d4 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:02.192868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1095/2192] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:01 2022] DELETE /identity/v3/users/c16f1b7950084e3eae38c7c45c19e2cf => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:02.196328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572eec-5077-4b43-90e9-37dd4eeccc43 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:02.198462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572eec-5077-4b43-90e9-37dd4eeccc43 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:02.198855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572eec-5077-4b43-90e9-37dd4eeccc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:02.254990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c46f6-fad5-4ca1-9c41-426b153f90fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:02.262763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c46f6-fad5-4ca1-9c41-426b153f90fd admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:02.262763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c46f6-fad5-4ca1-9c41-426b153f90fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:02.262763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c46f6-fad5-4ca1-9c41-426b153f90fd admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:02.262763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c46f6-fad5-4ca1-9c41-426b153f90fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:02.262763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c46f6-fad5-4ca1-9c41-426b153f90fd admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:02.263445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:02.267977 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-67572eec-5077-4b43-90e9-37dd4eeccc43 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:02.271077 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-67572eec-5077-4b43-90e9-37dd4eeccc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:02.293566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1096/2193] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:02.314224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572eec-5077-4b43-90e9-37dd4eeccc43 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:02.319877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-67572eec-5077-4b43-90e9-37dd4eeccc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:02.390162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572eec-5077-4b43-90e9-37dd4eeccc43 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:02.400272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f6279-409b-4389-9b4a-c57f5535b0af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:02.401414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6279-409b-4389-9b4a-c57f5535b0af service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:02.401954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6279-409b-4389-9b4a-c57f5535b0af service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:02.406004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6279-409b-4389-9b4a-c57f5535b0af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:02.421525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1098/2194] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:02 2022] POST /identity/v3/users => generated 287 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:30:02.422955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c46f6-fad5-4ca1-9c41-426b153f90fd admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:02.427045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f6279-409b-4389-9b4a-c57f5535b0af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:02.429137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f6279-409b-4389-9b4a-c57f5535b0af service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:02.447692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c46f6-fad5-4ca1-9c41-426b153f90fd admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:02.447814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1097/2195] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:30:02.447925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cab77-a2bc-4651-b124-46710043350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:02.447925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cab77-a2bc-4651-b124-46710043350e admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:02.447925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cab77-a2bc-4651-b124-46710043350e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:02.447925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cab77-a2bc-4651-b124-46710043350e admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:02.448365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3cab77-a2bc-4651-b124-46710043350e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:02.450051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3cab77-a2bc-4651-b124-46710043350e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:02.462371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1099/2196] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:30:02.467364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f6279-409b-4389-9b4a-c57f5535b0af service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:02.503810 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f6279-409b-4389-9b4a-c57f5535b0af service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:02.503810 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7850b36-eb1b-4656-972a-6679ced0ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:02.504512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7850b36-eb1b-4656-972a-6679ced0ad48 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:02.504668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7850b36-eb1b-4656-972a-6679ced0ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:02.504915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7850b36-eb1b-4656-972a-6679ced0ad48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:02.509708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7850b36-eb1b-4656-972a-6679ced0ad48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:02.509708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7850b36-eb1b-4656-972a-6679ced0ad48 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:02.528023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1098/2197] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:02.533307 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cab77-a2bc-4651-b124-46710043350e admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:02.555139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7850b36-eb1b-4656-972a-6679ced0ad48 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:02.558058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c7850b36-eb1b-4656-972a-6679ced0ad48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:02.563363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cab77-a2bc-4651-b124-46710043350e admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:02.594235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f2591-8564-4358-8977-54be6e649616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:02.595732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2591-8564-4358-8977-54be6e649616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:02.596358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2591-8564-4358-8977-54be6e649616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:02.596933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2591-8564-4358-8977-54be6e649616 admin admin] PATH_INFO: `/v3/projects/dc0d0f7c219344b284282826cbce3367/users/1af12db481604f15927d99ff07931b26/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:02.598707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7850b36-eb1b-4656-972a-6679ced0ad48 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:02.611502 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:02.612177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:02.612519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:02.612673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] PATH_INFO: `/v3/projects/928a902fd2f54d4c98c48b333744895b` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:02.614266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] RBAC: Authorizing `identity:delete_project(project_id=928a902fd2f54d4c98c48b333744895b)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:02.616693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:02.628249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f2591-8564-4358-8977-54be6e649616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0d0f7c219344b284282826cbce3367, user_id=1af12db481604f15927d99ff07931b26, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:02.631652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f2591-8564-4358-8977-54be6e649616 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:02.796438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1100/2198] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:02 2022] PUT /identity/v3/projects/dc0d0f7c219344b284282826cbce3367/users/1af12db481604f15927d99ff07931b26/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:30:02.808603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f1418-e145-4d60-94e9-e983f7f411f3 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:02.809094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f1418-e145-4d60-94e9-e983f7f411f3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:02.809595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f1418-e145-4d60-94e9-e983f7f411f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:02.842409 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928a902fd2f54d4c98c48b333744895b', 'request_id': 'req-6e8cefcc-0d7d-4802-bc59-961c0ee753de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:02.850603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928a902fd2f54d4c98c48b333744895b', 'request_id': 'req-6e8cefcc-0d7d-4802-bc59-961c0ee753de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:02.904744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-f88f1418-e145-4d60-94e9-e983f7f411f3 None None] MFA Rules not processed for user `1af12db481604f15927d99ff07931b26`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:02.910623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f88f1418-e145-4d60-94e9-e983f7f411f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:02.984984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928a902fd2f54d4c98c48b333744895b', 'request_id': 'req-6e8cefcc-0d7d-4802-bc59-961c0ee753de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.000425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] The token cache is being invalidate because project 928a902fd2f54d4c98c48b333744895b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:03.001517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.002652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.013350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1099/2199] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:02 2022] DELETE /identity/v3/projects/928a902fd2f54d4c98c48b333744895b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:03.015364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:03.017037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:03.050317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1101/2200] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:30:03.051411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f1418-e145-4d60-94e9-e983f7f411f3 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:03.065397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f88f1418-e145-4d60-94e9-e983f7f411f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:03.134246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cefcc-0d7d-4802-bc59-961c0ee753de admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:03.140018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:03.140667 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:03.140952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:03.141292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] PATH_INFO: `/v3/users/c0ae617835194053b1ee7331886bf1e1` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:03.142459 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ae617835194053b1ee7331886bf1e1)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:03.145207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:03.150834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f1418-e145-4d60-94e9-e983f7f411f3 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:03.160556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bd6fb-06bd-411a-9929-0cd55f027fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:03.161298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bd6fb-06bd-411a-9929-0cd55f027fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:03.161593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bd6fb-06bd-411a-9929-0cd55f027fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:03.162035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bd6fb-06bd-411a-9929-0cd55f027fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:03.162798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bd6fb-06bd-411a-9929-0cd55f027fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:03.164770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bd6fb-06bd-411a-9929-0cd55f027fe4 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:03.606481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1102/2201] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:03 2022] POST /identity/v3/projects => generated 371 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:03.607438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bd6fb-06bd-411a-9929-0cd55f027fe4 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:03.609695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-dc6bd6fb-06bd-411a-9929-0cd55f027fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:03.676872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bd6fb-06bd-411a-9929-0cd55f027fe4 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:03.682264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:03.682899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:03.683185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:03.683492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] PATH_INFO: `/v3/projects/3c27d043b6a64784a04e4461cd1fb5a4` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:03.684620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c27d043b6a64784a04e4461cd1fb5a4)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:03.686566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:03.750286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ae617835194053b1ee7331886bf1e1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.750878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ae617835194053b1ee7331886bf1e1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.751581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ae617835194053b1ee7331886bf1e1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.807688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:03.953519 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c27d043b6a64784a04e4461cd1fb5a4', 'request_id': 'req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.962008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ae617835194053b1ee7331886bf1e1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.967670 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c27d043b6a64784a04e4461cd1fb5a4', 'request_id': 'req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.985048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ae617835194053b1ee7331886bf1e1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:04.004592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1100/2202] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:03 2022] DELETE /identity/v3/users/c0ae617835194053b1ee7331886bf1e1 => generated 0 bytes in 991 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:04.005475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.006900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:04.119671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb6f1c-c45b-4e3d-8cfc-5e5edc199100 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.124380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c27d043b6a64784a04e4461cd1fb5a4', 'request_id': 'req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:04.124828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19da99-e12e-4c83-83c4-fcb8ae260712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.125631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19da99-e12e-4c83-83c4-fcb8ae260712 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.125816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19da99-e12e-4c83-83c4-fcb8ae260712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.126174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19da99-e12e-4c83-83c4-fcb8ae260712 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.126820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19da99-e12e-4c83-83c4-fcb8ae260712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.129200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19da99-e12e-4c83-83c4-fcb8ae260712 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.138744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] The token cache is being invalidate because project 3c27d043b6a64784a04e4461cd1fb5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:04.139143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:04.140279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90f36ff9-81a6-4000-8bf9-a96b46fa1eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:04.156493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1103/2203] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:03 2022] DELETE /identity/v3/projects/3c27d043b6a64784a04e4461cd1fb5a4 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:04.162228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195671c7-c0d8-407f-aaaa-db67080e60b5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.163882 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195671c7-c0d8-407f-aaaa-db67080e60b5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.164420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195671c7-c0d8-407f-aaaa-db67080e60b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.190629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-195671c7-c0d8-407f-aaaa-db67080e60b5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:04.191927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-195671c7-c0d8-407f-aaaa-db67080e60b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:04.201569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:04.204677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1104/2204] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:30:04.214395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22066c-04ff-4a8e-98b3-2ae67f9a3ac5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.214672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22066c-04ff-4a8e-98b3-2ae67f9a3ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.215123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22066c-04ff-4a8e-98b3-2ae67f9a3ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.236158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ea22066c-04ff-4a8e-98b3-2ae67f9a3ac5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:04.237519 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ea22066c-04ff-4a8e-98b3-2ae67f9a3ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:04.246151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1105/2205] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:04.249763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1101/2206] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:04.252958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22066c-04ff-4a8e-98b3-2ae67f9a3ac5 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.253465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19da99-e12e-4c83-83c4-fcb8ae260712 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.257067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-db19da99-e12e-4c83-83c4-fcb8ae260712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:04.263304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22066c-04ff-4a8e-98b3-2ae67f9a3ac5 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.268007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e15ae-9733-4fb3-85ff-583531ee1ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.268841 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e15ae-9733-4fb3-85ff-583531ee1ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.269304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e15ae-9733-4fb3-85ff-583531ee1ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.269583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e15ae-9733-4fb3-85ff-583531ee1ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.270440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e15ae-9733-4fb3-85ff-583531ee1ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:30:04.270748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e15ae-9733-4fb3-85ff-583531ee1ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.272925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e15ae-9733-4fb3-85ff-583531ee1ea9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.279401 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19da99-e12e-4c83-83c4-fcb8ae260712 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.286415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1106/2207] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:30:04.291131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e15ae-9733-4fb3-85ff-583531ee1ea9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.303109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e15ae-9733-4fb3-85ff-583531ee1ea9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.309489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5993546-bc2e-44e4-afe4-9a5e27ac5d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.310199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5993546-bc2e-44e4-afe4-9a5e27ac5d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.310481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5993546-bc2e-44e4-afe4-9a5e27ac5d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.310934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5993546-bc2e-44e4-afe4-9a5e27ac5d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.311779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5993546-bc2e-44e4-afe4-9a5e27ac5d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.311949 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eeb81-d9ba-4650-9a9c-bd9779e7a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.313190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eeb81-d9ba-4650-9a9c-bd9779e7a502 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.313658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eeb81-d9ba-4650-9a9c-bd9779e7a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.314007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5993546-bc2e-44e4-afe4-9a5e27ac5d63 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.314146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eeb81-d9ba-4650-9a9c-bd9779e7a502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.315292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723eeb81-d9ba-4650-9a9c-bd9779e7a502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.318956 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723eeb81-d9ba-4650-9a9c-bd9779e7a502 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.344943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1102/2208] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:30:04.346373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eeb81-d9ba-4650-9a9c-bd9779e7a502 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.357583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eeb81-d9ba-4650-9a9c-bd9779e7a502 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.363978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c77f35-1d62-413c-bd67-ea3f1dfbcfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.365422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c77f35-1d62-413c-bd67-ea3f1dfbcfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.365935 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c77f35-1d62-413c-bd67-ea3f1dfbcfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.366661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c77f35-1d62-413c-bd67-ea3f1dfbcfb7 admin admin] PATH_INFO: `/v3/projects/a334437056b74c4f836f4212eda3ba2f/users/9ca048c3295445339912f95e8d2a56e0/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.402994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c77f35-1d62-413c-bd67-ea3f1dfbcfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a334437056b74c4f836f4212eda3ba2f, user_id=9ca048c3295445339912f95e8d2a56e0, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.407791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c77f35-1d62-413c-bd67-ea3f1dfbcfb7 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.464346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1107/2209] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:30:04.469734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5993546-bc2e-44e4-afe4-9a5e27ac5d63 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.530318 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1103/2210] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:04 2022] PUT /identity/v3/projects/a334437056b74c4f836f4212eda3ba2f/users/9ca048c3295445339912f95e8d2a56e0/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:04.531331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c77f35-1d62-413c-bd67-ea3f1dfbcfb7 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.541474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5993546-bc2e-44e4-afe4-9a5e27ac5d63 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.622878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf62d54-5c3c-446c-ad8b-340d9f9485ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.627077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62d54-5c3c-446c-ad8b-340d9f9485ce admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.627077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62d54-5c3c-446c-ad8b-340d9f9485ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.627077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62d54-5c3c-446c-ad8b-340d9f9485ce admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.627559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c77f35-1d62-413c-bd67-ea3f1dfbcfb7 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.627743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf62d54-5c3c-446c-ad8b-340d9f9485ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.629725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf62d54-5c3c-446c-ad8b-340d9f9485ce admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.633447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1f8bb-f505-4ab6-9f1b-50fbcce2483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.634201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1f8bb-f505-4ab6-9f1b-50fbcce2483e admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.634550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1f8bb-f505-4ab6-9f1b-50fbcce2483e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.634891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1f8bb-f505-4ab6-9f1b-50fbcce2483e admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.635672 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1f8bb-f505-4ab6-9f1b-50fbcce2483e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.638577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1f8bb-f505-4ab6-9f1b-50fbcce2483e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.654978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1104/2211] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:04.659412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1f8bb-f505-4ab6-9f1b-50fbcce2483e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.669478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1f8bb-f505-4ab6-9f1b-50fbcce2483e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.674657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea55d83-43ac-42e2-81f2-f7a1b22d7cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.675322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea55d83-43ac-42e2-81f2-f7a1b22d7cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.675605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea55d83-43ac-42e2-81f2-f7a1b22d7cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.675883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea55d83-43ac-42e2-81f2-f7a1b22d7cd9 admin admin] PATH_INFO: `/v3/projects/a334437056b74c4f836f4212eda3ba2f/users/9ca048c3295445339912f95e8d2a56e0/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.678385 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea55d83-43ac-42e2-81f2-f7a1b22d7cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a334437056b74c4f836f4212eda3ba2f, user_id=9ca048c3295445339912f95e8d2a56e0, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.681178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea55d83-43ac-42e2-81f2-f7a1b22d7cd9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.710414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1105/2212] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:04 2022] PUT /identity/v3/projects/a334437056b74c4f836f4212eda3ba2f/users/9ca048c3295445339912f95e8d2a56e0/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:30:04.713043 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea55d83-43ac-42e2-81f2-f7a1b22d7cd9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.718762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-dea55d83-43ac-42e2-81f2-f7a1b22d7cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:04.797031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea55d83-43ac-42e2-81f2-f7a1b22d7cd9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.801761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.802412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.802693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.803539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] PATH_INFO: `/v3/projects/4e3d63f464844ca7864fa401cd436fd5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.804885 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3d63f464844ca7864fa401cd436fd5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.806844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.928552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1108/2213] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/users => generated 287 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:04.929839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e2f58-fb00-4bbe-a3bc-42f78edaacff None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.930125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e2f58-fb00-4bbe-a3bc-42f78edaacff None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.930403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e2f58-fb00-4bbe-a3bc-42f78edaacff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.959759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-249e2f58-fb00-4bbe-a3bc-42f78edaacff None None] MFA Rules not processed for user `9ca048c3295445339912f95e8d2a56e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:04.961368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-249e2f58-fb00-4bbe-a3bc-42f78edaacff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:05.042106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1109/2214] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:05.042725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e2f58-fb00-4bbe-a3bc-42f78edaacff None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.054487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e2f58-fb00-4bbe-a3bc-42f78edaacff None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.057800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3d63f464844ca7864fa401cd436fd5', 'request_id': 'req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:05.065212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3d63f464844ca7864fa401cd436fd5', 'request_id': 'req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:05.120152 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea5f26-0369-4411-8a60-6b54dfe09cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.120783 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5f26-0369-4411-8a60-6b54dfe09cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.121069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5f26-0369-4411-8a60-6b54dfe09cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.121358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5f26-0369-4411-8a60-6b54dfe09cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.122060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea5f26-0369-4411-8a60-6b54dfe09cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.123692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea5f26-0369-4411-8a60-6b54dfe09cf1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.134642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1110/2215] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:05.142575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea5f26-0369-4411-8a60-6b54dfe09cf1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.142575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-04ea5f26-0369-4411-8a60-6b54dfe09cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:05.202808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea5f26-0369-4411-8a60-6b54dfe09cf1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.206919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b734b-65a5-4cea-a39b-d252a198302c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.207550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b734b-65a5-4cea-a39b-d252a198302c service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.207840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b734b-65a5-4cea-a39b-d252a198302c service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.208119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b734b-65a5-4cea-a39b-d252a198302c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.256024 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3d63f464844ca7864fa401cd436fd5', 'request_id': 'req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:05.268182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] The token cache is being invalidate because project 4e3d63f464844ca7864fa401cd436fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:05.268474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:05.269162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:05.271096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1106/2216] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:04 2022] DELETE /identity/v3/projects/4e3d63f464844ca7864fa401cd436fd5 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:30:05.272040 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.273685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:05.286084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b734b-65a5-4cea-a39b-d252a198302c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.289460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b734b-65a5-4cea-a39b-d252a198302c service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.294390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c3ced-4d9f-473d-9ce3-aaad8299ae9d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.299864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf2a4f-da75-4380-a13a-dded75958b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.300174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf2a4f-da75-4380-a13a-dded75958b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.300456 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf2a4f-da75-4380-a13a-dded75958b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.300729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf2a4f-da75-4380-a13a-dded75958b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.301385 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf2a4f-da75-4380-a13a-dded75958b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.303649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf2a4f-da75-4380-a13a-dded75958b9e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.304469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1111/2217] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:05.305318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b734b-65a5-4cea-a39b-d252a198302c service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.316419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b734b-65a5-4cea-a39b-d252a198302c service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.316630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1107/2218] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:05.320872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf2a4f-da75-4380-a13a-dded75958b9e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.322489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.323138 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.323420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.323697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] PATH_INFO: `/v3/users/cc02964b40fa4ffb8f54d47ed9c5d573` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.324847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc02964b40fa4ffb8f54d47ed9c5d573)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.328229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.331177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf2a4f-da75-4380-a13a-dded75958b9e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.336932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48ff71-8d36-49a1-ad3b-d2924b59f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.339950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48ff71-8d36-49a1-ad3b-d2924b59f83a admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.339950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48ff71-8d36-49a1-ad3b-d2924b59f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.339950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48ff71-8d36-49a1-ad3b-d2924b59f83a admin admin] PATH_INFO: `/v3/projects/23e4ee9c81774ba48c122ec247e73c72/users/26a7962dce5849dd99e74d1e6b670b1f/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.359736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48ff71-8d36-49a1-ad3b-d2924b59f83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e4ee9c81774ba48c122ec247e73c72, user_id=26a7962dce5849dd99e74d1e6b670b1f, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.362496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48ff71-8d36-49a1-ad3b-d2924b59f83a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.515105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1108/2219] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:05 2022] PUT /identity/v3/projects/23e4ee9c81774ba48c122ec247e73c72/users/26a7962dce5849dd99e74d1e6b670b1f/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:30:05.535481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792052c-163e-4aa8-a748-103b73a944d3 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.535873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792052c-163e-4aa8-a748-103b73a944d3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.536458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792052c-163e-4aa8-a748-103b73a944d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.592968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1792052c-163e-4aa8-a748-103b73a944d3 None None] MFA Rules not processed for user `26a7962dce5849dd99e74d1e6b670b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:05.594253 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1792052c-163e-4aa8-a748-103b73a944d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:05.680403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1109/2220] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:05.685077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc02964b40fa4ffb8f54d47ed9c5d573'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:05.695901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792052c-163e-4aa8-a748-103b73a944d3 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.697371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1792052c-163e-4aa8-a748-103b73a944d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:05.768814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792052c-163e-4aa8-a748-103b73a944d3 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.772755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c573734-53c6-4922-8fa2-68cc6229c2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.773410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c573734-53c6-4922-8fa2-68cc6229c2ed service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.773716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c573734-53c6-4922-8fa2-68cc6229c2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.774005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c573734-53c6-4922-8fa2-68cc6229c2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.775870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2c573734-53c6-4922-8fa2-68cc6229c2ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:05.857545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c573734-53c6-4922-8fa2-68cc6229c2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.859042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c573734-53c6-4922-8fa2-68cc6229c2ed service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.869139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1110/2221] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:30:05.881593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc02964b40fa4ffb8f54d47ed9c5d573'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:05.898953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc02964b40fa4ffb8f54d47ed9c5d573'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:05.898953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc02964b40fa4ffb8f54d47ed9c5d573'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:05.898953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc02964b40fa4ffb8f54d47ed9c5d573'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:05.910174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1112/2222] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:05 2022] DELETE /identity/v3/users/cc02964b40fa4ffb8f54d47ed9c5d573 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:06.690085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c573734-53c6-4922-8fa2-68cc6229c2ed service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:06.691553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2c573734-53c6-4922-8fa2-68cc6229c2ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:06.760752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c573734-53c6-4922-8fa2-68cc6229c2ed service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:06.822751 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:06.823334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:06.823614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:06.823890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] PATH_INFO: `/v3/projects/c513f0e7a2af4de3a3fb218c11da3fc7` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:06.825210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c513f0e7a2af4de3a3fb218c11da3fc7)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:06.827251 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:06.912749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:06.918340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:07.017461 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223af049-d795-412d-97c7-f1c2cdb8b044 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.028665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638afae1-283f-467f-be5e-f9891bf38efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.029318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afae1-283f-467f-be5e-f9891bf38efc service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.029630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afae1-283f-467f-be5e-f9891bf38efc service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.029956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638afae1-283f-467f-be5e-f9891bf38efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.032023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-638afae1-283f-467f-be5e-f9891bf38efc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:07.043612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c513f0e7a2af4de3a3fb218c11da3fc7', 'request_id': 'req-df642830-39ca-4354-8313-dca4cef3e93d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:07.051630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c513f0e7a2af4de3a3fb218c11da3fc7', 'request_id': 'req-df642830-39ca-4354-8313-dca4cef3e93d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:07.107744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638afae1-283f-467f-be5e-f9891bf38efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.109413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638afae1-283f-467f-be5e-f9891bf38efc service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.122620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1113/2223] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:07.196148 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c513f0e7a2af4de3a3fb218c11da3fc7', 'request_id': 'req-df642830-39ca-4354-8313-dca4cef3e93d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:07.208119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] The token cache is being invalidate because project c513f0e7a2af4de3a3fb218c11da3fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:07.208531 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:07.209089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-df642830-39ca-4354-8313-dca4cef3e93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:07.210940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1111/2224] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:06 2022] DELETE /identity/v3/projects/c513f0e7a2af4de3a3fb218c11da3fc7 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:07.215926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1e2f8-ea1a-49e9-9692-9da3b1bf205c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.216273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1e2f8-ea1a-49e9-9692-9da3b1bf205c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.216558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1e2f8-ea1a-49e9-9692-9da3b1bf205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.238011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-98e1e2f8-ea1a-49e9-9692-9da3b1bf205c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:07.239230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-98e1e2f8-ea1a-49e9-9692-9da3b1bf205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:07.310377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1114/2225] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:07.319748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9baa1-be44-4ed5-a6f1-20744a5daac0 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.320186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9baa1-be44-4ed5-a6f1-20744a5daac0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.320512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9baa1-be44-4ed5-a6f1-20744a5daac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.347585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e4d9baa1-be44-4ed5-a6f1-20744a5daac0 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:07.348940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e4d9baa1-be44-4ed5-a6f1-20744a5daac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:07.358169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1112/2226] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:07.365194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1e2f8-ea1a-49e9-9692-9da3b1bf205c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.376851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1e2f8-ea1a-49e9-9692-9da3b1bf205c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.386054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f0785-fab2-4dc7-9b74-51fb3e4eddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.386054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0785-fab2-4dc7-9b74-51fb3e4eddc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.386054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0785-fab2-4dc7-9b74-51fb3e4eddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.386054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0785-fab2-4dc7-9b74-51fb3e4eddc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.386432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f0785-fab2-4dc7-9b74-51fb3e4eddc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:30:07.386432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f0785-fab2-4dc7-9b74-51fb3e4eddc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.386432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f0785-fab2-4dc7-9b74-51fb3e4eddc8 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.398891 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1115/2227] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:30:07.403236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9baa1-be44-4ed5-a6f1-20744a5daac0 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.413821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9baa1-be44-4ed5-a6f1-20744a5daac0 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.418548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f0f2-2d85-46b7-ab83-97884e2ade41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.419156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f0f2-2d85-46b7-ab83-97884e2ade41 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.419438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f0f2-2d85-46b7-ab83-97884e2ade41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.419709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f0f2-2d85-46b7-ab83-97884e2ade41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.420355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6f0f2-2d85-46b7-ab83-97884e2ade41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.422366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6f0f2-2d85-46b7-ab83-97884e2ade41 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.538618 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1113/2228] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:07 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:07.539980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f0785-fab2-4dc7-9b74-51fb3e4eddc8 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.553865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f0785-fab2-4dc7-9b74-51fb3e4eddc8 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.627910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234426ec-2b32-4c1c-8683-dddb57c66b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.628319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234426ec-2b32-4c1c-8683-dddb57c66b55 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.628319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234426ec-2b32-4c1c-8683-dddb57c66b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.628693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234426ec-2b32-4c1c-8683-dddb57c66b55 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.629264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234426ec-2b32-4c1c-8683-dddb57c66b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.631355 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234426ec-2b32-4c1c-8683-dddb57c66b55 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.659050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:07.779289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1116/2229] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:07 2022] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:07.785966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f0f2-2d85-46b7-ab83-97884e2ade41 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.797837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f0f2-2d85-46b7-ab83-97884e2ade41 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.804068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be267b56-1a28-4aba-8d8d-0f7976981258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.804910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be267b56-1a28-4aba-8d8d-0f7976981258 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.805287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be267b56-1a28-4aba-8d8d-0f7976981258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.805568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be267b56-1a28-4aba-8d8d-0f7976981258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.806412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be267b56-1a28-4aba-8d8d-0f7976981258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.807915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be267b56-1a28-4aba-8d8d-0f7976981258 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.824995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1114/2230] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:07.835416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234426ec-2b32-4c1c-8683-dddb57c66b55 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.845534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234426ec-2b32-4c1c-8683-dddb57c66b55 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.853436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd61a06-b285-4d4b-a9ef-4c64cd7c896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.854494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd61a06-b285-4d4b-a9ef-4c64cd7c896a admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.854785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd61a06-b285-4d4b-a9ef-4c64cd7c896a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.855066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd61a06-b285-4d4b-a9ef-4c64cd7c896a admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.855764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd61a06-b285-4d4b-a9ef-4c64cd7c896a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.857405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd61a06-b285-4d4b-a9ef-4c64cd7c896a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.874106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1117/2231] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:07.877654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be267b56-1a28-4aba-8d8d-0f7976981258 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.889430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be267b56-1a28-4aba-8d8d-0f7976981258 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.894430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1d17b-eeb1-4626-838b-6c77b9680817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.895170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1d17b-eeb1-4626-838b-6c77b9680817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.895441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1d17b-eeb1-4626-838b-6c77b9680817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.895843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1d17b-eeb1-4626-838b-6c77b9680817 admin admin] PATH_INFO: `/v3/projects/b5714e506cdc4dcdb086a3db3e1af8ee/users/bf151e161cf941f99f2195a5cd4dfad4/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.914115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1d17b-eeb1-4626-838b-6c77b9680817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5714e506cdc4dcdb086a3db3e1af8ee, user_id=bf151e161cf941f99f2195a5cd4dfad4, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.916833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1d17b-eeb1-4626-838b-6c77b9680817 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:08.002879 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1115/2232] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:07 2022] PUT /identity/v3/projects/b5714e506cdc4dcdb086a3db3e1af8ee/users/bf151e161cf941f99f2195a5cd4dfad4/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:08.015829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b405c80-356c-4ee5-9200-82752feb3c96 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:08.018302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b405c80-356c-4ee5-9200-82752feb3c96 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:08.019015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b405c80-356c-4ee5-9200-82752feb3c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:08.026880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:08.087354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9b405c80-356c-4ee5-9200-82752feb3c96 None None] MFA Rules not processed for user `bf151e161cf941f99f2195a5cd4dfad4`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:08.088799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9b405c80-356c-4ee5-9200-82752feb3c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:08.234763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1118/2233] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:08.243813 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1d17b-eeb1-4626-838b-6c77b9680817 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:08.245743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-bab1d17b-eeb1-4626-838b-6c77b9680817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:08.315528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1d17b-eeb1-4626-838b-6c77b9680817 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:08.322264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0131ce0-fdf3-42a7-86a7-e786e7961a5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f14e5614aee44c59a47b12e5b35ea3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:08.323643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0131ce0-fdf3-42a7-86a7-e786e7961a5c service glance] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:08.324023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0131ce0-fdf3-42a7-86a7-e786e7961a5c service glance] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:08.324741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0131ce0-fdf3-42a7-86a7-e786e7961a5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:08.336709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0131ce0-fdf3-42a7-86a7-e786e7961a5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:08.338234 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0131ce0-fdf3-42a7-86a7-e786e7961a5c service glance] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:08.348424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1116/2234] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:10.630718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:10.726764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7984e5-bbb3-46f0-9cfc-6556630f7e6c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:10.727257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7984e5-bbb3-46f0-9cfc-6556630f7e6c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:10.727385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7984e5-bbb3-46f0-9cfc-6556630f7e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:10.765846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-8b7984e5-bbb3-46f0-9cfc-6556630f7e6c None None] MFA Rules not processed for user `26a7962dce5849dd99e74d1e6b670b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:10.765846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8b7984e5-bbb3-46f0-9cfc-6556630f7e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:10.852890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1119/2235] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:11.458893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:12.584644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:15.373853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:16.429159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:20.011508 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:21.208015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:21.698927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0131ce0-fdf3-42a7-86a7-e786e7961a5c service glance] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:21.700374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e0131ce0-fdf3-42a7-86a7-e786e7961a5c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:21.769776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0131ce0-fdf3-42a7-86a7-e786e7961a5c service glance] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:21.774388 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:21.775011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:21.775285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:21.775554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] PATH_INFO: `/v3/users/d8e19e0752ad420ab0747610fc60a6d7` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:21.776655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e19e0752ad420ab0747610fc60a6d7)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:21.778598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:22.265922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e19e0752ad420ab0747610fc60a6d7'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.267045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e19e0752ad420ab0747610fc60a6d7'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.267769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e19e0752ad420ab0747610fc60a6d7'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.408909 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e19e0752ad420ab0747610fc60a6d7'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.428272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e19e0752ad420ab0747610fc60a6d7'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.462737 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1117/2236] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:21 2022] DELETE /identity/v3/users/d8e19e0752ad420ab0747610fc60a6d7 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:22.467086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0a82d-47f1-4523-8bbd-2a2aca66cea6 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:22.467534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0a82d-47f1-4523-8bbd-2a2aca66cea6 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:22.467720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0a82d-47f1-4523-8bbd-2a2aca66cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:22.488279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-39a0a82d-47f1-4523-8bbd-2a2aca66cea6 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:22.489502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-39a0a82d-47f1-4523-8bbd-2a2aca66cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:22.554969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1120/2237] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:30:22.567856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:22.576845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:22.635608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c83b-39f6-4760-a268-d549ba72f569 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:22.639314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a42a64-46bd-43e8-b693-34c933738ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:22.639960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42a64-46bd-43e8-b693-34c933738ccd service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:22.640289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42a64-46bd-43e8-b693-34c933738ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:22.640565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a42a64-46bd-43e8-b693-34c933738ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:22.650746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a42a64-46bd-43e8-b693-34c933738ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:22.652229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a42a64-46bd-43e8-b693-34c933738ccd service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:22.662655 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1118/2238] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:23.334908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0a82d-47f1-4523-8bbd-2a2aca66cea6 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:23.336607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-39a0a82d-47f1-4523-8bbd-2a2aca66cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:23.349027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0a82d-47f1-4523-8bbd-2a2aca66cea6 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:23.354640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:23.355338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.355616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.356775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] PATH_INFO: `/v3/projects/793eb1ecaf7945b3ba9d46234321208b` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.358318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] RBAC: Authorizing `identity:delete_project(project_id=793eb1ecaf7945b3ba9d46234321208b)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:23.360229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:23.610612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793eb1ecaf7945b3ba9d46234321208b', 'request_id': 'req-5727d86f-ab15-457f-9b39-b9b4a692827b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:23.622699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793eb1ecaf7945b3ba9d46234321208b', 'request_id': 'req-5727d86f-ab15-457f-9b39-b9b4a692827b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:23.846350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793eb1ecaf7945b3ba9d46234321208b', 'request_id': 'req-5727d86f-ab15-457f-9b39-b9b4a692827b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:23.859063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] The token cache is being invalidate because project 793eb1ecaf7945b3ba9d46234321208b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:23.860603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:23.860603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5727d86f-ab15-457f-9b39-b9b4a692827b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:23.863980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1121/2239] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:23 2022] DELETE /identity/v3/projects/793eb1ecaf7945b3ba9d46234321208b => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:23.867632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6ac8d-fa8f-4964-9bcf-32192a092698 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.868132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6ac8d-fa8f-4964-9bcf-32192a092698 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.868245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6ac8d-fa8f-4964-9bcf-32192a092698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.888823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-bfb6ac8d-fa8f-4964-9bcf-32192a092698 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:23.890088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-bfb6ac8d-fa8f-4964-9bcf-32192a092698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:23.988002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1119/2240] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:23.997478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113d82a-d3c6-4be1-84d6-c8246a492012 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.997795 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113d82a-d3c6-4be1-84d6-c8246a492012 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.998095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113d82a-d3c6-4be1-84d6-c8246a492012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:24.019658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3113d82a-d3c6-4be1-84d6-c8246a492012 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:24.025949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3113d82a-d3c6-4be1-84d6-c8246a492012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:24.033583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1122/2241] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:24.034424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6ac8d-fa8f-4964-9bcf-32192a092698 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:24.044472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6ac8d-fa8f-4964-9bcf-32192a092698 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:24.049322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494069e-9079-48f5-a018-4c197db486a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:24.049958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494069e-9079-48f5-a018-4c197db486a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:24.050241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494069e-9079-48f5-a018-4c197db486a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:24.050518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494069e-9079-48f5-a018-4c197db486a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:24.051217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494069e-9079-48f5-a018-4c197db486a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:30:24.051525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494069e-9079-48f5-a018-4c197db486a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:24.053216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494069e-9079-48f5-a018-4c197db486a9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:24.068360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1120/2242] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:30:24.076035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113d82a-d3c6-4be1-84d6-c8246a492012 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:24.087265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113d82a-d3c6-4be1-84d6-c8246a492012 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:24.092261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748dcf9-891c-41a5-ad9b-2c155281d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:24.092937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748dcf9-891c-41a5-ad9b-2c155281d4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:24.093216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748dcf9-891c-41a5-ad9b-2c155281d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:24.093487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748dcf9-891c-41a5-ad9b-2c155281d4f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:24.094574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748dcf9-891c-41a5-ad9b-2c155281d4f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:24.096580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748dcf9-891c-41a5-ad9b-2c155281d4f5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:24.318316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1123/2243] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:24 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:24.322414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494069e-9079-48f5-a018-4c197db486a9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:24.332264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494069e-9079-48f5-a018-4c197db486a9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:24.396284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c84c9d-5376-4d21-ad97-bb676ba40e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:24.396284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84c9d-5376-4d21-ad97-bb676ba40e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:24.396284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84c9d-5376-4d21-ad97-bb676ba40e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:24.396284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84c9d-5376-4d21-ad97-bb676ba40e0b admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:24.396753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c84c9d-5376-4d21-ad97-bb676ba40e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:24.396753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c84c9d-5376-4d21-ad97-bb676ba40e0b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:24.655022 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1121/2244] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:24 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:24.655608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748dcf9-891c-41a5-ad9b-2c155281d4f5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:24.666894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748dcf9-891c-41a5-ad9b-2c155281d4f5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:24.672510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a523129-a1b1-4dd9-8f8c-95592a5be182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:24.673123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a523129-a1b1-4dd9-8f8c-95592a5be182 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:24.673407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a523129-a1b1-4dd9-8f8c-95592a5be182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:24.673703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a523129-a1b1-4dd9-8f8c-95592a5be182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:24.674516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a523129-a1b1-4dd9-8f8c-95592a5be182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:24.676182 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a523129-a1b1-4dd9-8f8c-95592a5be182 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:24.691243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1124/2245] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:24.695640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c84c9d-5376-4d21-ad97-bb676ba40e0b admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:24.707912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c84c9d-5376-4d21-ad97-bb676ba40e0b admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:24.724538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3adb9-a3c2-409d-b9ab-53b77ee96bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:24.730590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3adb9-a3c2-409d-b9ab-53b77ee96bba admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:24.730590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3adb9-a3c2-409d-b9ab-53b77ee96bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:24.730590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3adb9-a3c2-409d-b9ab-53b77ee96bba admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:24.730590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3adb9-a3c2-409d-b9ab-53b77ee96bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:24.735800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3adb9-a3c2-409d-b9ab-53b77ee96bba admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:24.765714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1122/2246] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:24.767336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a523129-a1b1-4dd9-8f8c-95592a5be182 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:24.779671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a523129-a1b1-4dd9-8f8c-95592a5be182 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:24.785711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9662e8-ce60-483d-b356-77c658471990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:24.786805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9662e8-ce60-483d-b356-77c658471990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:24.787160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9662e8-ce60-483d-b356-77c658471990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:24.787517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9662e8-ce60-483d-b356-77c658471990 admin admin] PATH_INFO: `/v3/projects/1690ec2f9613408da65f2bf81f6f20e6/users/ff3b344073534df3b64fb708bcb8f746/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:24.809197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9662e8-ce60-483d-b356-77c658471990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1690ec2f9613408da65f2bf81f6f20e6, user_id=ff3b344073534df3b64fb708bcb8f746, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:24.811895 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9662e8-ce60-483d-b356-77c658471990 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:25.752222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1125/2247] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:24 2022] PUT /identity/v3/projects/1690ec2f9613408da65f2bf81f6f20e6/users/ff3b344073534df3b64fb708bcb8f746/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:25.757403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035b800-026c-4fba-89c9-0f0e91bdf45c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:25.757914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035b800-026c-4fba-89c9-0f0e91bdf45c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:25.758012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035b800-026c-4fba-89c9-0f0e91bdf45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:25.778830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-f035b800-026c-4fba-89c9-0f0e91bdf45c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:25.780071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f035b800-026c-4fba-89c9-0f0e91bdf45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:25.845711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1123/2248] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:25.855860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9662e8-ce60-483d-b356-77c658471990 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:25.857662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-cb9662e8-ce60-483d-b356-77c658471990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:25.921278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9662e8-ce60-483d-b356-77c658471990 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:25.926090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e9e7c-d805-412d-b3c4-ba3cdffee279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:25.926509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e9e7c-d805-412d-b3c4-ba3cdffee279 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:25.926723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e9e7c-d805-412d-b3c4-ba3cdffee279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:25.927000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e9e7c-d805-412d-b3c4-ba3cdffee279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:25.938706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e9e7c-d805-412d-b3c4-ba3cdffee279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:25.940199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e9e7c-d805-412d-b3c4-ba3cdffee279 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:25.951729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1126/2249] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:27.525755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:29.031736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:32.396544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:33.634344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:34.317771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0983f34-5a7c-4555-926a-15c1ee26b5bd None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:34.318285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0983f34-5a7c-4555-926a-15c1ee26b5bd None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:34.318564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0983f34-5a7c-4555-926a-15c1ee26b5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:34.362388 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-f0983f34-5a7c-4555-926a-15c1ee26b5bd None None] MFA Rules not processed for user `ff3b344073534df3b64fb708bcb8f746`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:34.363611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f0983f34-5a7c-4555-926a-15c1ee26b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:34.449784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1124/2250] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:30:34.452921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e9e7c-d805-412d-b3c4-ba3cdffee279 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:34.467810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e9e7c-d805-412d-b3c4-ba3cdffee279 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:34.473596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef549f51-4cae-4d6e-8d06-730b2eb5f6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:34.474265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549f51-4cae-4d6e-8d06-730b2eb5f6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:34.474613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549f51-4cae-4d6e-8d06-730b2eb5f6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:34.476695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549f51-4cae-4d6e-8d06-730b2eb5f6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:34.477630 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef549f51-4cae-4d6e-8d06-730b2eb5f6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:34.481846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef549f51-4cae-4d6e-8d06-730b2eb5f6d9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:34.616853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1127/2251] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:34 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:34.620898 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0983f34-5a7c-4555-926a-15c1ee26b5bd None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:34.633145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0983f34-5a7c-4555-926a-15c1ee26b5bd None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:34.707256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f563ea2-9a9e-4a93-a7f3-8dc874c62691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:34.715108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f563ea2-9a9e-4a93-a7f3-8dc874c62691 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:34.715108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f563ea2-9a9e-4a93-a7f3-8dc874c62691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:34.715108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f563ea2-9a9e-4a93-a7f3-8dc874c62691 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:34.715108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f563ea2-9a9e-4a93-a7f3-8dc874c62691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:34.715108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f563ea2-9a9e-4a93-a7f3-8dc874c62691 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:34.929815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1125/2252] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:34 2022] POST /identity/v3/users => generated 298 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:34.935541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef549f51-4cae-4d6e-8d06-730b2eb5f6d9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:34.950958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef549f51-4cae-4d6e-8d06-730b2eb5f6d9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:34.959426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6949cdc-7877-4736-8fdf-3a447ce910ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:34.962149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6949cdc-7877-4736-8fdf-3a447ce910ba admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:34.962149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6949cdc-7877-4736-8fdf-3a447ce910ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:34.962149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6949cdc-7877-4736-8fdf-3a447ce910ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:34.962417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6949cdc-7877-4736-8fdf-3a447ce910ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:34.964624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6949cdc-7877-4736-8fdf-3a447ce910ba admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:34.980714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1128/2253] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:34.981926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f563ea2-9a9e-4a93-a7f3-8dc874c62691 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:34.994397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f563ea2-9a9e-4a93-a7f3-8dc874c62691 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:34.999390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893556bc-0d1f-4c1e-b474-1863a7775b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:35.001311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893556bc-0d1f-4c1e-b474-1863a7775b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:35.001311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893556bc-0d1f-4c1e-b474-1863a7775b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:35.001311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893556bc-0d1f-4c1e-b474-1863a7775b0e admin admin] PATH_INFO: `/v3/projects/2a66df094aac4d65a05f0b06ae7a0afe/users/e6f1ac1752d84f58bf644a8cd9d0348a/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:35.023542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893556bc-0d1f-4c1e-b474-1863a7775b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a66df094aac4d65a05f0b06ae7a0afe, user_id=e6f1ac1752d84f58bf644a8cd9d0348a, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:35.026938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893556bc-0d1f-4c1e-b474-1863a7775b0e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:35.198018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1126/2254] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:34 2022] PUT /identity/v3/projects/2a66df094aac4d65a05f0b06ae7a0afe/users/e6f1ac1752d84f58bf644a8cd9d0348a/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:35.198190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6949cdc-7877-4736-8fdf-3a447ce910ba admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:35.215425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6949cdc-7877-4736-8fdf-3a447ce910ba admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:35.364215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14770e-d411-4b65-adfb-a617f09b0012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:35.364852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14770e-d411-4b65-adfb-a617f09b0012 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:35.365141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14770e-d411-4b65-adfb-a617f09b0012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:35.365426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14770e-d411-4b65-adfb-a617f09b0012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:35.367750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14770e-d411-4b65-adfb-a617f09b0012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:35.369417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14770e-d411-4b65-adfb-a617f09b0012 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:35.389825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1129/2255] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:30:35.391789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893556bc-0d1f-4c1e-b474-1863a7775b0e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:35.413948 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893556bc-0d1f-4c1e-b474-1863a7775b0e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:35.425144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d339207-944d-4d40-b444-c3889b4ce030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:35.429219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d339207-944d-4d40-b444-c3889b4ce030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:35.429219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d339207-944d-4d40-b444-c3889b4ce030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:35.429219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d339207-944d-4d40-b444-c3889b4ce030 admin admin] PATH_INFO: `/v3/projects/2a66df094aac4d65a05f0b06ae7a0afe/users/e6f1ac1752d84f58bf644a8cd9d0348a/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:35.430547 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d339207-944d-4d40-b444-c3889b4ce030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a66df094aac4d65a05f0b06ae7a0afe, user_id=e6f1ac1752d84f58bf644a8cd9d0348a, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:35.447115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d339207-944d-4d40-b444-c3889b4ce030 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:35.467860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1127/2256] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:35 2022] PUT /identity/v3/projects/2a66df094aac4d65a05f0b06ae7a0afe/users/e6f1ac1752d84f58bf644a8cd9d0348a/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:36.965106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:38.319546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:42.288813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120dc0-f62d-4cb9-81a2-0391a8c1e054 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:42.289842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120dc0-f62d-4cb9-81a2-0391a8c1e054 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:42.291046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120dc0-f62d-4cb9-81a2-0391a8c1e054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:42.335583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-65120dc0-f62d-4cb9-81a2-0391a8c1e054 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:42.344960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-65120dc0-f62d-4cb9-81a2-0391a8c1e054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:42.409307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d339207-944d-4d40-b444-c3889b4ce030 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:42.412330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8d339207-944d-4d40-b444-c3889b4ce030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:42.495868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1130/2257] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:30:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:42.515035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:42.584183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65120dc0-f62d-4cb9-81a2-0391a8c1e054 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:42.587861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-65120dc0-f62d-4cb9-81a2-0391a8c1e054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:42.599412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d339207-944d-4d40-b444-c3889b4ce030 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:42.610790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:42.612934 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:42.613640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:42.614328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] PATH_INFO: `/v3/users/829c6d3ee8c646608325b3a5b66af6de` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:42.616460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829c6d3ee8c646608325b3a5b66af6de)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:42.621339 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:42.669312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:42.779957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65120dc0-f62d-4cb9-81a2-0391a8c1e054 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:42.785099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879a3ec-35e9-4bde-9625-b64e8f316c77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:42.787046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a3ec-35e9-4bde-9625-b64e8f316c77 service swift] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:42.787545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a3ec-35e9-4bde-9625-b64e8f316c77 service swift] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:42.787948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a3ec-35e9-4bde-9625-b64e8f316c77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:42.808556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879a3ec-35e9-4bde-9625-b64e8f316c77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:42.810882 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879a3ec-35e9-4bde-9625-b64e8f316c77 service swift] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:42.836444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829c6d3ee8c646608325b3a5b66af6de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:42.838013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829c6d3ee8c646608325b3a5b66af6de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:42.839728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829c6d3ee8c646608325b3a5b66af6de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:42.854361 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1131/2258] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:30:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:30:42.984308 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829c6d3ee8c646608325b3a5b66af6de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:43.002025 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829c6d3ee8c646608325b3a5b66af6de'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:43.018265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1128/2259] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:42 2022] DELETE /identity/v3/users/829c6d3ee8c646608325b3a5b66af6de => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:43.023254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea66a-c1ed-477a-b3fc-b9fef706c388 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:43.023793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea66a-c1ed-477a-b3fc-b9fef706c388 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:43.024229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ea66a-c1ed-477a-b3fc-b9fef706c388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:43.046569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4b9ea66a-c1ed-477a-b3fc-b9fef706c388 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:43.047799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4b9ea66a-c1ed-477a-b3fc-b9fef706c388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:43.143309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1132/2260] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:30:43.155395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:43.157487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:43.258060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a3f46-45e3-476a-baf1-563d38b8aa74 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:43.263397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbd3d8-df3f-4f03-b0d4-5ea4dd69e362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:43.264403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd3d8-df3f-4f03-b0d4-5ea4dd69e362 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:43.265012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd3d8-df3f-4f03-b0d4-5ea4dd69e362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:43.265298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd3d8-df3f-4f03-b0d4-5ea4dd69e362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:43.284500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbd3d8-df3f-4f03-b0d4-5ea4dd69e362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:43.284500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbd3d8-df3f-4f03-b0d4-5ea4dd69e362 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:43.299919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1129/2261] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:43.904762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ea66a-c1ed-477a-b3fc-b9fef706c388 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:43.908291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4b9ea66a-c1ed-477a-b3fc-b9fef706c388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:43.971581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ea66a-c1ed-477a-b3fc-b9fef706c388 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:44.000231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:44.002475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:44.002767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:44.003141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] PATH_INFO: `/v3/projects/61610fa0bb6245e4b4ce4698e46abf55` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:44.009351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61610fa0bb6245e4b4ce4698e46abf55)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:44.022150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:44.247843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61610fa0bb6245e4b4ce4698e46abf55', 'request_id': 'req-0ceca9e4-83b1-4069-9db0-3e8858ee7236'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:44.251926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61610fa0bb6245e4b4ce4698e46abf55', 'request_id': 'req-0ceca9e4-83b1-4069-9db0-3e8858ee7236'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:44.381722 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61610fa0bb6245e4b4ce4698e46abf55', 'request_id': 'req-0ceca9e4-83b1-4069-9db0-3e8858ee7236'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:44.400730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] The token cache is being invalidate because project 61610fa0bb6245e4b4ce4698e46abf55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:44.401032 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:44.401791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0ceca9e4-83b1-4069-9db0-3e8858ee7236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:44.407764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1133/2262] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:43 2022] DELETE /identity/v3/projects/61610fa0bb6245e4b4ce4698e46abf55 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:44.409721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223708e6-8757-4be5-bca5-729f53b0a782 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:44.410191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223708e6-8757-4be5-bca5-729f53b0a782 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:44.410498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223708e6-8757-4be5-bca5-729f53b0a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:44.438508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-223708e6-8757-4be5-bca5-729f53b0a782 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:44.440694 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-223708e6-8757-4be5-bca5-729f53b0a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:44.448853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f88ba7-43b4-4e4b-8532-0c3c8d233969 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:44.455141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f88ba7-43b4-4e4b-8532-0c3c8d233969 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:44.455141 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f88ba7-43b4-4e4b-8532-0c3c8d233969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:44.508774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-38f88ba7-43b4-4e4b-8532-0c3c8d233969 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:44.510587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-38f88ba7-43b4-4e4b-8532-0c3c8d233969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:44.538617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1130/2263] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:44.547745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acffe-1a9b-47a0-9079-1305b50d4870 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:44.548297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acffe-1a9b-47a0-9079-1305b50d4870 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:44.548738 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acffe-1a9b-47a0-9079-1305b50d4870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:44.577233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-117acffe-1a9b-47a0-9079-1305b50d4870 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:44.578804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-117acffe-1a9b-47a0-9079-1305b50d4870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:44.589219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1131/2264] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:44.594152 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117acffe-1a9b-47a0-9079-1305b50d4870 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:44.609458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117acffe-1a9b-47a0-9079-1305b50d4870 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:44.618978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ae89-6a88-4ba8-8692-cf58087db465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:44.619924 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ae89-6a88-4ba8-8692-cf58087db465 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:44.620205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ae89-6a88-4ba8-8692-cf58087db465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:44.620479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ae89-6a88-4ba8-8692-cf58087db465 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:44.621146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6ae89-6a88-4ba8-8692-cf58087db465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:30:44.621450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6ae89-6a88-4ba8-8692-cf58087db465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:44.624557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6ae89-6a88-4ba8-8692-cf58087db465 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:44.628692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1134/2265] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 31 19:30:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:30:44.663999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:44.666261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f88ba7-43b4-4e4b-8532-0c3c8d233969 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:44.669982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-38f88ba7-43b4-4e4b-8532-0c3c8d233969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:44.672947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1132/2266] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:30:44.677529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ae89-6a88-4ba8-8692-cf58087db465 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:44.703097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ae89-6a88-4ba8-8692-cf58087db465 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:44.748845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc3b30-51cf-4f3d-bce1-7483306bb16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:44.750533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc3b30-51cf-4f3d-bce1-7483306bb16c admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:44.750830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc3b30-51cf-4f3d-bce1-7483306bb16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:44.751108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc3b30-51cf-4f3d-bce1-7483306bb16c admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:44.755393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc3b30-51cf-4f3d-bce1-7483306bb16c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:44.762787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc3b30-51cf-4f3d-bce1-7483306bb16c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:44.842807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f88ba7-43b4-4e4b-8532-0c3c8d233969 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:44.853794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8552c3-fbbd-4920-9c8c-df7ab03f4241 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:44.854186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8552c3-fbbd-4920-9c8c-df7ab03f4241 service swift] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:44.854594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8552c3-fbbd-4920-9c8c-df7ab03f4241 service swift] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:44.854981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8552c3-fbbd-4920-9c8c-df7ab03f4241 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:44.864732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8552c3-fbbd-4920-9c8c-df7ab03f4241 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:44.867252 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8552c3-fbbd-4920-9c8c-df7ab03f4241 service swift] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:44.880693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1135/2267] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:30:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:30:44.982441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1133/2268] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:44 2022] POST /identity/v3/projects => generated 391 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:30:44.986663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8552c3-fbbd-4920-9c8c-df7ab03f4241 service swift] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:45.005648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8552c3-fbbd-4920-9c8c-df7ab03f4241 service swift] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:45.083775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47142c94-51dd-46af-8ae9-bfe92c2ef5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:45.092923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47142c94-51dd-46af-8ae9-bfe92c2ef5ea admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:45.092923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47142c94-51dd-46af-8ae9-bfe92c2ef5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:45.092923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47142c94-51dd-46af-8ae9-bfe92c2ef5ea admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:45.092923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47142c94-51dd-46af-8ae9-bfe92c2ef5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:45.092923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47142c94-51dd-46af-8ae9-bfe92c2ef5ea admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:45.193061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:45.233447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1136/2269] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:44 2022] POST /identity/v3/users => generated 296 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:45.238474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc3b30-51cf-4f3d-bce1-7483306bb16c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:45.255761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc3b30-51cf-4f3d-bce1-7483306bb16c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:45.261651 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d186a5-d081-4f47-962b-ca6cc9eda53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:45.262619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d186a5-d081-4f47-962b-ca6cc9eda53e admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:45.268194 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d186a5-d081-4f47-962b-ca6cc9eda53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:45.271245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d186a5-d081-4f47-962b-ca6cc9eda53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:45.282599 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d186a5-d081-4f47-962b-ca6cc9eda53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:45.284271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d186a5-d081-4f47-962b-ca6cc9eda53e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:45.302871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1134/2270] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:45.305387 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e47f2-ec3d-4cb1-bf47-3c3e2888fabe None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:45.307520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e47f2-ec3d-4cb1-bf47-3c3e2888fabe None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:45.307864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d186a5-d081-4f47-962b-ca6cc9eda53e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:45.308356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e47f2-ec3d-4cb1-bf47-3c3e2888fabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:45.320335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d186a5-d081-4f47-962b-ca6cc9eda53e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:45.325281 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b155f-8bcc-4111-931a-07d34e337098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:45.325936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b155f-8bcc-4111-931a-07d34e337098 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:45.326215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b155f-8bcc-4111-931a-07d34e337098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:45.326536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b155f-8bcc-4111-931a-07d34e337098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:45.327191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b155f-8bcc-4111-931a-07d34e337098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:45.328943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b155f-8bcc-4111-931a-07d34e337098 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:45.340299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1135/2271] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:45.344741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b155f-8bcc-4111-931a-07d34e337098 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:45.356622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b155f-8bcc-4111-931a-07d34e337098 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:45.359363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-fe5e47f2-ec3d-4cb1-bf47-3c3e2888fabe None None] MFA Rules not processed for user `e6f1ac1752d84f58bf644a8cd9d0348a`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:45.360636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-fe5e47f2-ec3d-4cb1-bf47-3c3e2888fabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:45.362469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dfd0e-7356-4629-a504-0354b27bf90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:45.363369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dfd0e-7356-4629-a504-0354b27bf90a admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:45.363651 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dfd0e-7356-4629-a504-0354b27bf90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:45.363917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dfd0e-7356-4629-a504-0354b27bf90a admin admin] PATH_INFO: `/v3/projects/72e5b64b158941d48d93cb6172b04699/users/4dc2b2df10704768834415944340ef8a/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:45.386037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dfd0e-7356-4629-a504-0354b27bf90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e5b64b158941d48d93cb6172b04699, user_id=4dc2b2df10704768834415944340ef8a, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:45.391636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dfd0e-7356-4629-a504-0354b27bf90a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:45.440587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1137/2272] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:45.453246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e47f2-ec3d-4cb1-bf47-3c3e2888fabe None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:45.455177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-fe5e47f2-ec3d-4cb1-bf47-3c3e2888fabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:45.480988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1136/2273] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:45 2022] PUT /identity/v3/projects/72e5b64b158941d48d93cb6172b04699/users/4dc2b2df10704768834415944340ef8a/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:30:45.493571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400da1-09d9-4609-8cfc-933ca9f2f835 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:45.493918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400da1-09d9-4609-8cfc-933ca9f2f835 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:45.494320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400da1-09d9-4609-8cfc-933ca9f2f835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:45.552995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4b400da1-09d9-4609-8cfc-933ca9f2f835 None None] MFA Rules not processed for user `4dc2b2df10704768834415944340ef8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:45.554920 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4b400da1-09d9-4609-8cfc-933ca9f2f835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:45.559105 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e47f2-ec3d-4cb1-bf47-3c3e2888fabe None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:45.622469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247f59d-c40f-403c-9911-5f1ba6b862d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f14e5614aee44c59a47b12e5b35ea3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:45.623100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247f59d-c40f-403c-9911-5f1ba6b862d6 service glance] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:45.623515 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247f59d-c40f-403c-9911-5f1ba6b862d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:45.623647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247f59d-c40f-403c-9911-5f1ba6b862d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:45.625590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8247f59d-c40f-403c-9911-5f1ba6b862d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:45.635444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1137/2274] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:30:45.669820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400da1-09d9-4609-8cfc-933ca9f2f835 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:45.671362 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4b400da1-09d9-4609-8cfc-933ca9f2f835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:45.709094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247f59d-c40f-403c-9911-5f1ba6b862d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:45.711706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247f59d-c40f-403c-9911-5f1ba6b862d6 service glance] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:45.727397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1138/2275] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:30:45.765019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400da1-09d9-4609-8cfc-933ca9f2f835 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:45.768830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7fc1b-7b07-4fe0-a46a-d0923b6f1734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:45.769517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7fc1b-7b07-4fe0-a46a-d0923b6f1734 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:45.769836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7fc1b-7b07-4fe0-a46a-d0923b6f1734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:45.770116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7fc1b-7b07-4fe0-a46a-d0923b6f1734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:45.779933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7fc1b-7b07-4fe0-a46a-d0923b6f1734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:45.781378 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7fc1b-7b07-4fe0-a46a-d0923b6f1734 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:45.791260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1138/2276] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:46.503811 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576ec5c-93bd-48d3-adbb-ba00b274cd3a None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:46.504392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994fd25-6799-425b-bbf2-cb18879ea7d5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:46.504392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994fd25-6799-425b-bbf2-cb18879ea7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:46.504860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576ec5c-93bd-48d3-adbb-ba00b274cd3a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:46.504860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576ec5c-93bd-48d3-adbb-ba00b274cd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:46.505041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994fd25-6799-425b-bbf2-cb18879ea7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:46.529530 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-0576ec5c-93bd-48d3-adbb-ba00b274cd3a None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:46.530886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0576ec5c-93bd-48d3-adbb-ba00b274cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:46.534679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e994fd25-6799-425b-bbf2-cb18879ea7d5 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:46.536076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e994fd25-6799-425b-bbf2-cb18879ea7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:46.606477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1139/2277] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:30:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:46.617778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1139/2278] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:30:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:46.619861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576ec5c-93bd-48d3-adbb-ba00b274cd3a None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:46.631829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994fd25-6799-425b-bbf2-cb18879ea7d5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:46.751875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994fd25-6799-425b-bbf2-cb18879ea7d5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:46.759001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17460540-75ce-4631-a3e3-3c264176d522 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:46.762691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460540-75ce-4631-a3e3-3c264176d522 service swift] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:46.762691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460540-75ce-4631-a3e3-3c264176d522 service swift] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:46.762973 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460540-75ce-4631-a3e3-3c264176d522 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:46.763220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576ec5c-93bd-48d3-adbb-ba00b274cd3a None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:46.769502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d84624-3f65-4bb5-a6d8-a763868a47b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:46.770176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d84624-3f65-4bb5-a6d8-a763868a47b6 service swift] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:46.770488 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d84624-3f65-4bb5-a6d8-a763868a47b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:46.771011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d84624-3f65-4bb5-a6d8-a763868a47b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:46.774649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17460540-75ce-4631-a3e3-3c264176d522 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:46.776449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17460540-75ce-4631-a3e3-3c264176d522 service swift] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:46.782561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d84624-3f65-4bb5-a6d8-a763868a47b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:46.784899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d84624-3f65-4bb5-a6d8-a763868a47b6 service swift] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:46.788598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1140/2279] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:30:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 19:30:46.795627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1140/2280] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:30:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 19:30:47.918850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502e175-21ee-4eac-87fe-976d1a68afa0 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:47.919805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502e175-21ee-4eac-87fe-976d1a68afa0 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:47.920238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502e175-21ee-4eac-87fe-976d1a68afa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:47.942876 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-f502e175-21ee-4eac-87fe-976d1a68afa0 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:47.944244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f502e175-21ee-4eac-87fe-976d1a68afa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:47.952512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1141/2281] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 31 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:47.970096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d84624-3f65-4bb5-a6d8-a763868a47b6 service swift] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:47.982145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d84624-3f65-4bb5-a6d8-a763868a47b6 service swift] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:47.988026 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ca43f-0628-4821-8862-55eaeba7fff5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:47.988844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ca43f-0628-4821-8862-55eaeba7fff5 service swift] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:47.989127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ca43f-0628-4821-8862-55eaeba7fff5 service swift] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:47.989404 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ca43f-0628-4821-8862-55eaeba7fff5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:48.005125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ca43f-0628-4821-8862-55eaeba7fff5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:48.007816 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ca43f-0628-4821-8862-55eaeba7fff5 service swift] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:48.020778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1141/2282] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:30:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 19:30:48.426772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:48.855174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecef406-d0b3-44f5-ba82-593e982c9b2e None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:48.855654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecef406-d0b3-44f5-ba82-593e982c9b2e None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:48.856007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecef406-d0b3-44f5-ba82-593e982c9b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:48.890368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1ecef406-d0b3-44f5-ba82-593e982c9b2e None None] MFA Rules not processed for user `6773bc20a0d740e588f1858e5e9b1d11`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:48.900546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1ecef406-d0b3-44f5-ba82-593e982c9b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:49.040099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1142/2283] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:49.048603 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:51.675493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:52.374626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:53.488257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ca43f-0628-4821-8862-55eaeba7fff5 service swift] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:53.490716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ef6ca43f-0628-4821-8862-55eaeba7fff5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:53.594313 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ca43f-0628-4821-8862-55eaeba7fff5 service swift] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:53.594509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:53.595375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:53.595734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:53.596110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] PATH_INFO: `/v3/users/26a7962dce5849dd99e74d1e6b670b1f` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:53.597429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a7962dce5849dd99e74d1e6b670b1f)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:53.600423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:54.026160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a7962dce5849dd99e74d1e6b670b1f'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:54.135786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a7962dce5849dd99e74d1e6b670b1f'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:54.136944 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a7962dce5849dd99e74d1e6b670b1f'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:54.165206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a7962dce5849dd99e74d1e6b670b1f'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:54.166172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a7962dce5849dd99e74d1e6b670b1f'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:54.192384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1142/2284] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:53 2022] DELETE /identity/v3/users/26a7962dce5849dd99e74d1e6b670b1f => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:54.197484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae89a2-7ec2-47c9-ade7-1ea64f5f8132 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:54.202026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae89a2-7ec2-47c9-ade7-1ea64f5f8132 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:54.202026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae89a2-7ec2-47c9-ade7-1ea64f5f8132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:54.227724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-aeae89a2-7ec2-47c9-ade7-1ea64f5f8132 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:54.228988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-aeae89a2-7ec2-47c9-ade7-1ea64f5f8132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:54.421174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1143/2285] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:54.447773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:54.447773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:54.586532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada973af-3082-433f-a1f8-ede4670d825f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:54.605855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a855afe-eb3c-4725-afb5-4dc91513118e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:54.610651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a855afe-eb3c-4725-afb5-4dc91513118e service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:54.611281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a855afe-eb3c-4725-afb5-4dc91513118e service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:54.611600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a855afe-eb3c-4725-afb5-4dc91513118e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:54.639860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a855afe-eb3c-4725-afb5-4dc91513118e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:54.643150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a855afe-eb3c-4725-afb5-4dc91513118e service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:54.660899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1143/2286] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:55.184313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae89a2-7ec2-47c9-ade7-1ea64f5f8132 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:55.185809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-aeae89a2-7ec2-47c9-ade7-1ea64f5f8132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:55.209053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae89a2-7ec2-47c9-ade7-1ea64f5f8132 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:55.226742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:55.248869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:55.259089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:55.259089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:55.259089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] PATH_INFO: `/v3/projects/23e4ee9c81774ba48c122ec247e73c72` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:55.262700 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e4ee9c81774ba48c122ec247e73c72)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:55.265943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:55.546620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e4ee9c81774ba48c122ec247e73c72', 'request_id': 'req-2309024a-b642-4c3b-9ce5-fbb34fe75874'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:55.570474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e4ee9c81774ba48c122ec247e73c72', 'request_id': 'req-2309024a-b642-4c3b-9ce5-fbb34fe75874'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:55.734501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e4ee9c81774ba48c122ec247e73c72', 'request_id': 'req-2309024a-b642-4c3b-9ce5-fbb34fe75874'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:55.754455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] The token cache is being invalidate because project 23e4ee9c81774ba48c122ec247e73c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:55.754951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:55.755671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2309024a-b642-4c3b-9ce5-fbb34fe75874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:55.757702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1144/2287] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:55 2022] DELETE /identity/v3/projects/23e4ee9c81774ba48c122ec247e73c72 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:57.191689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:59.449312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:00.521973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a855afe-eb3c-4725-afb5-4dc91513118e service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:00.523590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6a855afe-eb3c-4725-afb5-4dc91513118e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:00.536893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a855afe-eb3c-4725-afb5-4dc91513118e service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:00.607676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb5e65-392c-40e5-b075-d5794226ee14 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:00.608171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb5e65-392c-40e5-b075-d5794226ee14 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:00.608171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb5e65-392c-40e5-b075-d5794226ee14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:00.610365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:00.611181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:00.611479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:00.611770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] PATH_INFO: `/v3/users/bf151e161cf941f99f2195a5cd4dfad4` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:00.612963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf151e161cf941f99f2195a5cd4dfad4)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:00.614989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:00.631991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-7bbb5e65-392c-40e5-b075-d5794226ee14 None None] MFA Rules not processed for user `ff3b344073534df3b64fb708bcb8f746`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:00.634320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7bbb5e65-392c-40e5-b075-d5794226ee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:00.695366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1145/2288] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:31:01.037169 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf151e161cf941f99f2195a5cd4dfad4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:01.157180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf151e161cf941f99f2195a5cd4dfad4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:01.157887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf151e161cf941f99f2195a5cd4dfad4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:01.172507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf151e161cf941f99f2195a5cd4dfad4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:01.173407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf151e161cf941f99f2195a5cd4dfad4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:01.187854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1144/2289] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:00 2022] DELETE /identity/v3/users/bf151e161cf941f99f2195a5cd4dfad4 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:01.193000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f067e5f-5022-467b-b7d6-35213ef75ac5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:01.193336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f067e5f-5022-467b-b7d6-35213ef75ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:01.193792 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f067e5f-5022-467b-b7d6-35213ef75ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:01.217873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4f067e5f-5022-467b-b7d6-35213ef75ac5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:01.219073 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4f067e5f-5022-467b-b7d6-35213ef75ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:01.284481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1146/2290] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:01.295967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:01.297416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:01.360182 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372a77b-b4fb-4fd4-9245-44663e272648 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:01.363827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db942da5-47f5-4999-b4d2-2a36aa897031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:01.364463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db942da5-47f5-4999-b4d2-2a36aa897031 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:01.364769 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db942da5-47f5-4999-b4d2-2a36aa897031 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:01.365049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db942da5-47f5-4999-b4d2-2a36aa897031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:01.375524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db942da5-47f5-4999-b4d2-2a36aa897031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:01.377113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db942da5-47f5-4999-b4d2-2a36aa897031 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:01.392411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1145/2291] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:01.452567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:01.966632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f067e5f-5022-467b-b7d6-35213ef75ac5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:01.968277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4f067e5f-5022-467b-b7d6-35213ef75ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:01.982519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f067e5f-5022-467b-b7d6-35213ef75ac5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:01.988814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:01.989542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:01.990052 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:01.990332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] PATH_INFO: `/v3/projects/b5714e506cdc4dcdb086a3db3e1af8ee` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:01.991859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5714e506cdc4dcdb086a3db3e1af8ee)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:01.994387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:02.198057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:02.233023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5714e506cdc4dcdb086a3db3e1af8ee', 'request_id': 'req-dc0fbc61-b528-409c-a341-fb1eed9d045e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:02.250606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5714e506cdc4dcdb086a3db3e1af8ee', 'request_id': 'req-dc0fbc61-b528-409c-a341-fb1eed9d045e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:02.415608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5714e506cdc4dcdb086a3db3e1af8ee', 'request_id': 'req-dc0fbc61-b528-409c-a341-fb1eed9d045e'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:02.435736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] The token cache is being invalidate because project b5714e506cdc4dcdb086a3db3e1af8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:02.436093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:02.437001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:02.438969 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1147/2292] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:01 2022] DELETE /identity/v3/projects/b5714e506cdc4dcdb086a3db3e1af8ee => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:05.149299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:05.966738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:07.410216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece88d5-62ff-481a-b1fd-917185902464 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:07.410877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece88d5-62ff-481a-b1fd-917185902464 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:07.410877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece88d5-62ff-481a-b1fd-917185902464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:07.432174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-aece88d5-62ff-481a-b1fd-917185902464 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:07.433518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-aece88d5-62ff-481a-b1fd-917185902464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:07.498377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1146/2293] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:31:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:07.510669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:07.512404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:07.589069 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fbc61-b528-409c-a341-fb1eed9d045e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:07.594419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbad13-264d-4146-8324-292fe104731e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:07.595046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbad13-264d-4146-8324-292fe104731e service swift] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:07.595338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbad13-264d-4146-8324-292fe104731e service swift] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:07.595609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbad13-264d-4146-8324-292fe104731e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:07.604993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbad13-264d-4146-8324-292fe104731e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:07.606869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbad13-264d-4146-8324-292fe104731e service swift] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:07.615821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1148/2294] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:31:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:31:08.093093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece88d5-62ff-481a-b1fd-917185902464 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:08.094078 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-aece88d5-62ff-481a-b1fd-917185902464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:08.293270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece88d5-62ff-481a-b1fd-917185902464 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:08.300057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:08.301101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:08.301248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:08.301609 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] PATH_INFO: `/v3/users/4dc2b2df10704768834415944340ef8a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:08.303234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc2b2df10704768834415944340ef8a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:08.306976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:08.594467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc2b2df10704768834415944340ef8a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:08.757194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc2b2df10704768834415944340ef8a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:08.758390 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc2b2df10704768834415944340ef8a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:08.778464 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc2b2df10704768834415944340ef8a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:08.779239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc2b2df10704768834415944340ef8a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:08.794848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1147/2295] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:08 2022] DELETE /identity/v3/users/4dc2b2df10704768834415944340ef8a => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:08.799021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce7ab-ab44-4125-9d2b-136cac042643 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:08.799514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce7ab-ab44-4125-9d2b-136cac042643 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:08.799624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce7ab-ab44-4125-9d2b-136cac042643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:08.833587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-490ce7ab-ab44-4125-9d2b-136cac042643 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:08.835000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-490ce7ab-ab44-4125-9d2b-136cac042643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:08.890162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:08.899716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1149/2296] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:31:08.912170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:08.914635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:08.979625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec92b78-429f-42b1-bd99-51f126c0daa2 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:08.983362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3722b4-6d23-49be-957f-cf02c7d011d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:08.984061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3722b4-6d23-49be-957f-cf02c7d011d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:08.984413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3722b4-6d23-49be-957f-cf02c7d011d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:08.984757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3722b4-6d23-49be-957f-cf02c7d011d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:08.995192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3722b4-6d23-49be-957f-cf02c7d011d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:08.996864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3722b4-6d23-49be-957f-cf02c7d011d2 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:09.007750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1148/2297] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:09.241447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:09.524627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce7ab-ab44-4125-9d2b-136cac042643 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:09.526383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-490ce7ab-ab44-4125-9d2b-136cac042643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:09.560769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce7ab-ab44-4125-9d2b-136cac042643 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:09.572213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:09.573455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:09.573915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:09.574367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] PATH_INFO: `/v3/projects/72e5b64b158941d48d93cb6172b04699` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:09.577196 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e5b64b158941d48d93cb6172b04699)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:09.579452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:09.769287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e5b64b158941d48d93cb6172b04699', 'request_id': 'req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:09.776496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e5b64b158941d48d93cb6172b04699', 'request_id': 'req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:09.932127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e5b64b158941d48d93cb6172b04699', 'request_id': 'req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:09.956019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] The token cache is being invalidate because project 72e5b64b158941d48d93cb6172b04699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:09.956316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:09.957123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6b05e21b-46a3-4324-8fc9-c1d3ba1b37fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:09.959395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1150/2298] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:09 2022] DELETE /identity/v3/projects/72e5b64b158941d48d93cb6172b04699 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:09.964461 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2addd-648c-4e8f-ab1d-0f148e522e18 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:09.964973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2addd-648c-4e8f-ab1d-0f148e522e18 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:09.965092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2addd-648c-4e8f-ab1d-0f148e522e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:09.991056 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-58e2addd-648c-4e8f-ab1d-0f148e522e18 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:09.992776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-58e2addd-648c-4e8f-ab1d-0f148e522e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:10.068520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1149/2299] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:10.069964 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80869-84ae-424c-bdfa-033096641336 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:10.070255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80869-84ae-424c-bdfa-033096641336 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:10.070536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80869-84ae-424c-bdfa-033096641336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:10.093050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-47a80869-84ae-424c-bdfa-033096641336 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:10.094407 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-47a80869-84ae-424c-bdfa-033096641336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:10.106260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1151/2300] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:31:10.109380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2addd-648c-4e8f-ab1d-0f148e522e18 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:10.120455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2addd-648c-4e8f-ab1d-0f148e522e18 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:10.125459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91437f4e-dd7e-46ca-8794-235a5a8ebb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:10.126110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437f4e-dd7e-46ca-8794-235a5a8ebb50 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:10.126386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437f4e-dd7e-46ca-8794-235a5a8ebb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:10.126656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437f4e-dd7e-46ca-8794-235a5a8ebb50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:10.127313 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91437f4e-dd7e-46ca-8794-235a5a8ebb50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:10.127617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91437f4e-dd7e-46ca-8794-235a5a8ebb50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:10.129228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91437f4e-dd7e-46ca-8794-235a5a8ebb50 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:10.145494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1150/2301] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:10.146725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a80869-84ae-424c-bdfa-033096641336 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:10.157760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a80869-84ae-424c-bdfa-033096641336 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:10.166488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1412cb6-dfe0-43dd-8419-d194474aef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:10.166488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1412cb6-dfe0-43dd-8419-d194474aef42 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:10.166488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1412cb6-dfe0-43dd-8419-d194474aef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:10.166488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1412cb6-dfe0-43dd-8419-d194474aef42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:10.166960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1412cb6-dfe0-43dd-8419-d194474aef42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:10.167613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1412cb6-dfe0-43dd-8419-d194474aef42 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:10.340966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1152/2302] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:10 2022] POST /identity/v3/projects => generated 399 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:31:10.343912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91437f4e-dd7e-46ca-8794-235a5a8ebb50 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:10.358668 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91437f4e-dd7e-46ca-8794-235a5a8ebb50 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:10.424290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a56623-ab64-4a5c-91c1-9266c4248ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:10.425015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a56623-ab64-4a5c-91c1-9266c4248ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:10.425402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a56623-ab64-4a5c-91c1-9266c4248ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:10.425810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a56623-ab64-4a5c-91c1-9266c4248ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:10.426557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a56623-ab64-4a5c-91c1-9266c4248ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:10.428602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a56623-ab64-4a5c-91c1-9266c4248ae1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:10.596758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1151/2303] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:10 2022] POST /identity/v3/users => generated 300 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:10.601402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1412cb6-dfe0-43dd-8419-d194474aef42 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:10.620209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1412cb6-dfe0-43dd-8419-d194474aef42 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:10.625279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cbc0c-b5eb-4746-9972-0da77767b503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:10.634296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cbc0c-b5eb-4746-9972-0da77767b503 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:10.634296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cbc0c-b5eb-4746-9972-0da77767b503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:10.634296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cbc0c-b5eb-4746-9972-0da77767b503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:10.634296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cbc0c-b5eb-4746-9972-0da77767b503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:10.634296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cbc0c-b5eb-4746-9972-0da77767b503 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:10.663284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1153/2304] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:10.668857 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a56623-ab64-4a5c-91c1-9266c4248ae1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:10.680062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a56623-ab64-4a5c-91c1-9266c4248ae1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:10.692365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790e157-afce-49d6-b98e-07b1601936ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:10.699894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790e157-afce-49d6-b98e-07b1601936ed admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:10.699894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790e157-afce-49d6-b98e-07b1601936ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:10.699894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790e157-afce-49d6-b98e-07b1601936ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:10.699894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790e157-afce-49d6-b98e-07b1601936ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:10.699894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790e157-afce-49d6-b98e-07b1601936ed admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:10.736103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1152/2305] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:10.737631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cbc0c-b5eb-4746-9972-0da77767b503 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:10.764088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cbc0c-b5eb-4746-9972-0da77767b503 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:10.783720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e51bb-037d-4132-8acb-98081068ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:10.783720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e51bb-037d-4132-8acb-98081068ab38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:10.783720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e51bb-037d-4132-8acb-98081068ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:10.783720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e51bb-037d-4132-8acb-98081068ab38 admin admin] PATH_INFO: `/v3/projects/8294f34865ad4a0ea0d91c2e606b9b07/users/254884b9d985428f969f44220451a5f0/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:10.820484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e51bb-037d-4132-8acb-98081068ab38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8294f34865ad4a0ea0d91c2e606b9b07, user_id=254884b9d985428f969f44220451a5f0, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:10.820484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e51bb-037d-4132-8acb-98081068ab38 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:10.919202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:10.925202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1154/2306] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:10 2022] PUT /identity/v3/projects/8294f34865ad4a0ea0d91c2e606b9b07/users/254884b9d985428f969f44220451a5f0/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:10.936947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366aa54-ca3e-4e09-8681-cad099a4d17b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:10.937259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366aa54-ca3e-4e09-8681-cad099a4d17b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:10.937549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366aa54-ca3e-4e09-8681-cad099a4d17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:10.970440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-3366aa54-ca3e-4e09-8681-cad099a4d17b None None] MFA Rules not processed for user `254884b9d985428f969f44220451a5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:10.971787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3366aa54-ca3e-4e09-8681-cad099a4d17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:11.065968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1153/2307] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:11.083507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e51bb-037d-4132-8acb-98081068ab38 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:11.086669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9b2e51bb-037d-4132-8acb-98081068ab38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:11.167541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e51bb-037d-4132-8acb-98081068ab38 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:11.171659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d14a8-c878-430d-bcc7-05f81fcdf34e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:11.172387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d14a8-c878-430d-bcc7-05f81fcdf34e service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:11.172744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d14a8-c878-430d-bcc7-05f81fcdf34e service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:11.173010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d14a8-c878-430d-bcc7-05f81fcdf34e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:11.184460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d14a8-c878-430d-bcc7-05f81fcdf34e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:11.186002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d14a8-c878-430d-bcc7-05f81fcdf34e service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:11.196784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1155/2308] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:11.494539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:14.185705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366aa54-ca3e-4e09-8681-cad099a4d17b None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:14.187262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3366aa54-ca3e-4e09-8681-cad099a4d17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:14.268405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366aa54-ca3e-4e09-8681-cad099a4d17b None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:14.273793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:14.274434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:14.274714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:14.274986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] PATH_INFO: `/v3/users/1af12db481604f15927d99ff07931b26` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:14.276166 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af12db481604f15927d99ff07931b26)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:14.278115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:14.562786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af12db481604f15927d99ff07931b26'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:14.668092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af12db481604f15927d99ff07931b26'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:14.668708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af12db481604f15927d99ff07931b26'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:14.683072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af12db481604f15927d99ff07931b26'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:14.684267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af12db481604f15927d99ff07931b26'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:14.699165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1154/2309] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:14 2022] DELETE /identity/v3/users/1af12db481604f15927d99ff07931b26 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:14.704991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196661-02b1-4023-b0d4-543f646fb462 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:14.704991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196661-02b1-4023-b0d4-543f646fb462 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:14.704991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196661-02b1-4023-b0d4-543f646fb462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:14.726721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-be196661-02b1-4023-b0d4-543f646fb462 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:14.727944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-be196661-02b1-4023-b0d4-543f646fb462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:14.797422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1156/2310] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:14.805540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:14.807270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:14.873392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778190d-e7df-422d-ade4-e2dda053b71d admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:14.877651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b4c9-b136-4393-ab7c-e9678b4b86aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:14.878305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b4c9-b136-4393-ab7c-e9678b4b86aa service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:14.878577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b4c9-b136-4393-ab7c-e9678b4b86aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:14.878911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b4c9-b136-4393-ab7c-e9678b4b86aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:14.890015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9b4c9-b136-4393-ab7c-e9678b4b86aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:14.892003 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9b4c9-b136-4393-ab7c-e9678b4b86aa service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:14.903025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1155/2311] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:15.227356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:15.445070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be196661-02b1-4023-b0d4-543f646fb462 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:15.446824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-be196661-02b1-4023-b0d4-543f646fb462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:15.462213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be196661-02b1-4023-b0d4-543f646fb462 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:15.468066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:15.468753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:15.469031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:15.469296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] PATH_INFO: `/v3/projects/dc0d0f7c219344b284282826cbce3367` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:15.470504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0d0f7c219344b284282826cbce3367)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:15.472446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:15.506013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:15.630087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0d0f7c219344b284282826cbce3367', 'request_id': 'req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:15.658809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0d0f7c219344b284282826cbce3367', 'request_id': 'req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:15.797349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0d0f7c219344b284282826cbce3367', 'request_id': 'req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:15.809184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] The token cache is being invalidate because project dc0d0f7c219344b284282826cbce3367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:15.809481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:15.810158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:15.811954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1157/2312] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:15 2022] DELETE /identity/v3/projects/dc0d0f7c219344b284282826cbce3367 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:15.815718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b4c9-b136-4393-ab7c-e9678b4b86aa service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:15.828053 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b4c9-b136-4393-ab7c-e9678b4b86aa service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:15.932597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:15.933430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:15.933748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:15.934080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] PATH_INFO: `/v3/users/9ca048c3295445339912f95e8d2a56e0` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:15.935818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca048c3295445339912f95e8d2a56e0)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:15.938299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:16.208481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca048c3295445339912f95e8d2a56e0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:16.334618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca048c3295445339912f95e8d2a56e0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:16.335162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca048c3295445339912f95e8d2a56e0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:16.348092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca048c3295445339912f95e8d2a56e0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:16.350187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-43b365a3-b72b-4322-9122-22bfea781be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca048c3295445339912f95e8d2a56e0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:16.363041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1156/2313] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:15 2022] DELETE /identity/v3/users/9ca048c3295445339912f95e8d2a56e0 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:16.913056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:16.915769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:16.946427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b293d-7ef1-4dd8-9f22-04e257dd9e7d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:17.056439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:17.057083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:17.057365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:17.057640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] PATH_INFO: `/v3/projects/a334437056b74c4f836f4212eda3ba2f` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:17.058878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a334437056b74c4f836f4212eda3ba2f)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:17.060796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:17.216403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a334437056b74c4f836f4212eda3ba2f', 'request_id': 'req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:17.224037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a334437056b74c4f836f4212eda3ba2f', 'request_id': 'req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:17.368799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a334437056b74c4f836f4212eda3ba2f', 'request_id': 'req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:17.381626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] The token cache is being invalidate because project a334437056b74c4f836f4212eda3ba2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:17.390789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:17.390789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b0fa0e9f-1a9d-4b5c-a053-b15adc056f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:17.390789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1158/2314] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:16 2022] DELETE /identity/v3/projects/a334437056b74c4f836f4212eda3ba2f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:17.391097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c89204-e5ff-4e2d-9f90-3619f699457f None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:17.391581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c89204-e5ff-4e2d-9f90-3619f699457f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:17.391581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c89204-e5ff-4e2d-9f90-3619f699457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:17.413078 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e1c89204-e5ff-4e2d-9f90-3619f699457f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:17.414391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e1c89204-e5ff-4e2d-9f90-3619f699457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:17.475071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1157/2315] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:17.484444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63ac94-6c30-43b4-aa66-6b566ccf181f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:17.484735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63ac94-6c30-43b4-aa66-6b566ccf181f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:17.485012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63ac94-6c30-43b4-aa66-6b566ccf181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:17.505558 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-fd63ac94-6c30-43b4-aa66-6b566ccf181f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:17.506843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fd63ac94-6c30-43b4-aa66-6b566ccf181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:17.515761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1159/2316] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:17.520140 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c89204-e5ff-4e2d-9f90-3619f699457f None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:17.530859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c89204-e5ff-4e2d-9f90-3619f699457f None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:17.541228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa12128-46cc-4607-8409-e38e68678f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:17.541894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa12128-46cc-4607-8409-e38e68678f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:17.542374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa12128-46cc-4607-8409-e38e68678f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:17.542655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa12128-46cc-4607-8409-e38e68678f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:17.543325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa12128-46cc-4607-8409-e38e68678f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:17.543640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa12128-46cc-4607-8409-e38e68678f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:17.545270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa12128-46cc-4607-8409-e38e68678f44 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:17.558534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1158/2317] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:31:17.563032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63ac94-6c30-43b4-aa66-6b566ccf181f None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:17.572886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63ac94-6c30-43b4-aa66-6b566ccf181f None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:17.577755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca2da5-7d9c-4d67-b73c-ea1d40775ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:17.578381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca2da5-7d9c-4d67-b73c-ea1d40775ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:17.578661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca2da5-7d9c-4d67-b73c-ea1d40775ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:17.578943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca2da5-7d9c-4d67-b73c-ea1d40775ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:17.579871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca2da5-7d9c-4d67-b73c-ea1d40775ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:17.581494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca2da5-7d9c-4d67-b73c-ea1d40775ab8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:17.596903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:17.753886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1160/2318] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:17 2022] POST /identity/v3/projects => generated 407 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:17.758757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa12128-46cc-4607-8409-e38e68678f44 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:17.769937 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa12128-46cc-4607-8409-e38e68678f44 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:17.832022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb193a0f-fa36-4d46-9142-d145a3aae22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:17.832648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb193a0f-fa36-4d46-9142-d145a3aae22b admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:17.832936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb193a0f-fa36-4d46-9142-d145a3aae22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:17.833217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb193a0f-fa36-4d46-9142-d145a3aae22b admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:17.833927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb193a0f-fa36-4d46-9142-d145a3aae22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:17.835980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb193a0f-fa36-4d46-9142-d145a3aae22b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:17.866111 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:17.987177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1159/2319] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:17 2022] POST /identity/v3/users => generated 304 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:31:17.992513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca2da5-7d9c-4d67-b73c-ea1d40775ab8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:18.002584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca2da5-7d9c-4d67-b73c-ea1d40775ab8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:18.009822 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb9690-d600-4916-9505-601d41642317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:18.010657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb9690-d600-4916-9505-601d41642317 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:18.011158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb9690-d600-4916-9505-601d41642317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:18.011579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb9690-d600-4916-9505-601d41642317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:18.012395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb9690-d600-4916-9505-601d41642317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:18.014489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb9690-d600-4916-9505-601d41642317 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:18.027361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1161/2320] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:18.031170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb193a0f-fa36-4d46-9142-d145a3aae22b admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:18.045176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb193a0f-fa36-4d46-9142-d145a3aae22b admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:18.057996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76c7e0-f32a-45da-b8f7-dff4f8c22641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:18.058818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c7e0-f32a-45da-b8f7-dff4f8c22641 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:18.059276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c7e0-f32a-45da-b8f7-dff4f8c22641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:18.060760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c7e0-f32a-45da-b8f7-dff4f8c22641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:18.061184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76c7e0-f32a-45da-b8f7-dff4f8c22641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:18.062985 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76c7e0-f32a-45da-b8f7-dff4f8c22641 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:18.079426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1160/2321] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:18.087391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb9690-d600-4916-9505-601d41642317 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:18.104549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb9690-d600-4916-9505-601d41642317 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:18.109718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e22dde-1f5a-45e4-ad33-d8f112049a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:18.110663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e22dde-1f5a-45e4-ad33-d8f112049a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:18.111015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e22dde-1f5a-45e4-ad33-d8f112049a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:18.111374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e22dde-1f5a-45e4-ad33-d8f112049a65 admin admin] PATH_INFO: `/v3/projects/66d9049c15984fd59e0536dc745e1f41/users/eb36765660b848fe89ab99e96359b400/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:18.155261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e22dde-1f5a-45e4-ad33-d8f112049a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d9049c15984fd59e0536dc745e1f41, user_id=eb36765660b848fe89ab99e96359b400, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:18.158735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e22dde-1f5a-45e4-ad33-d8f112049a65 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:18.312058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1162/2322] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:18 2022] PUT /identity/v3/projects/66d9049c15984fd59e0536dc745e1f41/users/eb36765660b848fe89ab99e96359b400/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:18.322867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620972dd-0f4e-4455-93c1-a577dc795487 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:18.323162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620972dd-0f4e-4455-93c1-a577dc795487 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:18.323446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620972dd-0f4e-4455-93c1-a577dc795487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:18.354246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-620972dd-0f4e-4455-93c1-a577dc795487 None None] MFA Rules not processed for user `eb36765660b848fe89ab99e96359b400`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:18.360654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-620972dd-0f4e-4455-93c1-a577dc795487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:18.421460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1161/2323] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:18 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:18.426092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e22dde-1f5a-45e4-ad33-d8f112049a65 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:18.491091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e22dde-1f5a-45e4-ad33-d8f112049a65 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:18.498720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3499a-01d3-4447-8050-65e6f72e183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:18.498720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3499a-01d3-4447-8050-65e6f72e183e admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:18.498720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3499a-01d3-4447-8050-65e6f72e183e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:18.498720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3499a-01d3-4447-8050-65e6f72e183e admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:18.499124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3499a-01d3-4447-8050-65e6f72e183e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:18.499538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3499a-01d3-4447-8050-65e6f72e183e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:18.610789 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1163/2324] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:18 2022] POST /identity/v3/projects => generated 409 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:18.615199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620972dd-0f4e-4455-93c1-a577dc795487 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:18.625988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620972dd-0f4e-4455-93c1-a577dc795487 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:18.682596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e3f5-92fe-4fd5-bd16-ecbe641374e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:18.683224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e3f5-92fe-4fd5-bd16-ecbe641374e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:18.683511 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e3f5-92fe-4fd5-bd16-ecbe641374e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:18.683792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e3f5-92fe-4fd5-bd16-ecbe641374e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:18.684471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285e3f5-92fe-4fd5-bd16-ecbe641374e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:18.686601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285e3f5-92fe-4fd5-bd16-ecbe641374e6 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:18.813418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1162/2325] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:18 2022] POST /identity/v3/users => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:18.817709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3499a-01d3-4447-8050-65e6f72e183e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:18.828900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3499a-01d3-4447-8050-65e6f72e183e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:18.833610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf79fc9-84e9-4141-8930-1025509e1e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:18.834244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf79fc9-84e9-4141-8930-1025509e1e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:18.834522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf79fc9-84e9-4141-8930-1025509e1e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:18.834793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf79fc9-84e9-4141-8930-1025509e1e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:18.835436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf79fc9-84e9-4141-8930-1025509e1e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:18.837689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf79fc9-84e9-4141-8930-1025509e1e2f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:18.849191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1164/2326] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:18.853608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e3f5-92fe-4fd5-bd16-ecbe641374e6 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:18.863774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e3f5-92fe-4fd5-bd16-ecbe641374e6 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:18.868729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff41e-31e2-4c03-b45b-4a19cf70fe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:18.869384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff41e-31e2-4c03-b45b-4a19cf70fe46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:18.869691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff41e-31e2-4c03-b45b-4a19cf70fe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:18.870108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff41e-31e2-4c03-b45b-4a19cf70fe46 admin admin] PATH_INFO: `/v3/projects/804ca6358e31414abd83e5cd210c2dd7/users/df50a55b77d24c4fa27b136c1801cd81/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:18.885973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ff41e-31e2-4c03-b45b-4a19cf70fe46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=804ca6358e31414abd83e5cd210c2dd7, user_id=df50a55b77d24c4fa27b136c1801cd81, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:18.888643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ff41e-31e2-4c03-b45b-4a19cf70fe46 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:18.996212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1163/2327] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:18 2022] PUT /identity/v3/projects/804ca6358e31414abd83e5cd210c2dd7/users/df50a55b77d24c4fa27b136c1801cd81/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:19.000345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf79fc9-84e9-4141-8930-1025509e1e2f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:19.010350 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf79fc9-84e9-4141-8930-1025509e1e2f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:19.066364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a836a-a468-4dff-9bc5-d574bf21992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:19.066889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a836a-a468-4dff-9bc5-d574bf21992a admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:19.067169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a836a-a468-4dff-9bc5-d574bf21992a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:19.067444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a836a-a468-4dff-9bc5-d574bf21992a admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:19.068114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a836a-a468-4dff-9bc5-d574bf21992a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:19.069764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a836a-a468-4dff-9bc5-d574bf21992a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:19.079791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1165/2328] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:19.084090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff41e-31e2-4c03-b45b-4a19cf70fe46 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:19.095096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff41e-31e2-4c03-b45b-4a19cf70fe46 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:19.100623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4587d6e-30bb-4c95-ad69-917b196d1ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:19.101290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587d6e-30bb-4c95-ad69-917b196d1ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:19.101569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587d6e-30bb-4c95-ad69-917b196d1ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:19.102425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587d6e-30bb-4c95-ad69-917b196d1ad7 admin admin] PATH_INFO: `/v3/projects/804ca6358e31414abd83e5cd210c2dd7/users/df50a55b77d24c4fa27b136c1801cd81/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:19.104363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4587d6e-30bb-4c95-ad69-917b196d1ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=804ca6358e31414abd83e5cd210c2dd7, user_id=df50a55b77d24c4fa27b136c1801cd81, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:19.107060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4587d6e-30bb-4c95-ad69-917b196d1ad7 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:19.117232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1164/2329] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:19 2022] PUT /identity/v3/projects/804ca6358e31414abd83e5cd210c2dd7/users/df50a55b77d24c4fa27b136c1801cd81/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:19.127343 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e0b40-671e-497e-a0d9-5f3f91a9f366 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:19.127637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e0b40-671e-497e-a0d9-5f3f91a9f366 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:19.127921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e0b40-671e-497e-a0d9-5f3f91a9f366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:19.155904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5f7e0b40-671e-497e-a0d9-5f3f91a9f366 None None] MFA Rules not processed for user `df50a55b77d24c4fa27b136c1801cd81`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:19.157150 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5f7e0b40-671e-497e-a0d9-5f3f91a9f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:19.225032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1166/2330] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:19 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:19.237337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4587d6e-30bb-4c95-ad69-917b196d1ad7 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:19.238499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e4587d6e-30bb-4c95-ad69-917b196d1ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:19.324494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4587d6e-30bb-4c95-ad69-917b196d1ad7 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:19.328128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368d67-e40c-49dd-89e8-a190c718788b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:19.328737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368d67-e40c-49dd-89e8-a190c718788b service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:19.329020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368d67-e40c-49dd-89e8-a190c718788b service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:19.329287 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368d67-e40c-49dd-89e8-a190c718788b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:19.339849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5368d67-e40c-49dd-89e8-a190c718788b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:19.341454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5368d67-e40c-49dd-89e8-a190c718788b service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:19.357899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1165/2331] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:19 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:19.380874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:19.557352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:19.889817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e0b40-671e-497e-a0d9-5f3f91a9f366 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:19.899657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e0b40-671e-497e-a0d9-5f3f91a9f366 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:19.903264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1172a77-05dc-488d-b5c7-b5faead18b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:19.903869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1172a77-05dc-488d-b5c7-b5faead18b49 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:19.904191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1172a77-05dc-488d-b5c7-b5faead18b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:19.904471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1172a77-05dc-488d-b5c7-b5faead18b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:19.959509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1172a77-05dc-488d-b5c7-b5faead18b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:19.960951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1172a77-05dc-488d-b5c7-b5faead18b49 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:19.969994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1167/2332] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:19 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:31:21.037534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:21.627255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368d67-e40c-49dd-89e8-a190c718788b service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:21.628757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c5368d67-e40c-49dd-89e8-a190c718788b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:21.697808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368d67-e40c-49dd-89e8-a190c718788b service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:21.702589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:21.703257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:21.703595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:21.703775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] PATH_INFO: `/v3/users/254884b9d985428f969f44220451a5f0` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:21.705340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=254884b9d985428f969f44220451a5f0)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:21.707315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:21.977916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254884b9d985428f969f44220451a5f0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:22.087324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254884b9d985428f969f44220451a5f0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:22.088028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254884b9d985428f969f44220451a5f0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:22.101862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254884b9d985428f969f44220451a5f0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:22.102615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254884b9d985428f969f44220451a5f0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:22.115007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1166/2333] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:21 2022] DELETE /identity/v3/users/254884b9d985428f969f44220451a5f0 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:22.119658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda6093-b1d5-4bbc-b34e-d90ff6a14e00 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:22.120122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda6093-b1d5-4bbc-b34e-d90ff6a14e00 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:22.120231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda6093-b1d5-4bbc-b34e-d90ff6a14e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:22.139784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9fda6093-b1d5-4bbc-b34e-d90ff6a14e00 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:22.141007 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9fda6093-b1d5-4bbc-b34e-d90ff6a14e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:22.201081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1168/2334] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:22.211703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:22.213133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:22.275165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f69d7-b6a5-4d1d-ae71-3fb666e483fe admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:22.278797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7897-8341-4a58-b425-c94709f7db73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:22.279407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7897-8341-4a58-b425-c94709f7db73 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:22.279688 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7897-8341-4a58-b425-c94709f7db73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:22.279961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7897-8341-4a58-b425-c94709f7db73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:22.289607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c7897-8341-4a58-b425-c94709f7db73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:22.291074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c7897-8341-4a58-b425-c94709f7db73 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:22.300968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1167/2335] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:22.340945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:22.775754 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda6093-b1d5-4bbc-b34e-d90ff6a14e00 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:22.777289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9fda6093-b1d5-4bbc-b34e-d90ff6a14e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:22.790741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda6093-b1d5-4bbc-b34e-d90ff6a14e00 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:22.795329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:22.795977 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:22.796594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:22.797054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] PATH_INFO: `/v3/projects/8294f34865ad4a0ea0d91c2e606b9b07` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:22.799116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8294f34865ad4a0ea0d91c2e606b9b07)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:22.801092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:22.894849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8294f34865ad4a0ea0d91c2e606b9b07', 'request_id': 'req-5c7b648e-302a-4c4c-99c0-426f0d500470'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:22.902019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8294f34865ad4a0ea0d91c2e606b9b07', 'request_id': 'req-5c7b648e-302a-4c4c-99c0-426f0d500470'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:22.991631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8294f34865ad4a0ea0d91c2e606b9b07', 'request_id': 'req-5c7b648e-302a-4c4c-99c0-426f0d500470'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:23.003479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] The token cache is being invalidate because project 8294f34865ad4a0ea0d91c2e606b9b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:23.003999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:23.004794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5c7b648e-302a-4c4c-99c0-426f0d500470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:23.007231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1169/2336] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:22 2022] DELETE /identity/v3/projects/8294f34865ad4a0ea0d91c2e606b9b07 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:31:23.643619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:24.498563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:25.557770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:26.260316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:27.677776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:28.711806 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7897-8341-4a58-b425-c94709f7db73 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:28.711806 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8a6c7897-8341-4a58-b425-c94709f7db73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:28.724321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7897-8341-4a58-b425-c94709f7db73 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:28.782054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:28.782695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:28.782980 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:28.783406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] PATH_INFO: `/v3/users/eb36765660b848fe89ab99e96359b400` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:28.784553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb36765660b848fe89ab99e96359b400)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:28.786535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:28.934556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:29.037877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb36765660b848fe89ab99e96359b400'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:29.145977 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb36765660b848fe89ab99e96359b400'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:29.146651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb36765660b848fe89ab99e96359b400'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:29.159420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb36765660b848fe89ab99e96359b400'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:29.160071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb36765660b848fe89ab99e96359b400'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:29.172613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1168/2337] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:28 2022] DELETE /identity/v3/users/eb36765660b848fe89ab99e96359b400 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:29.177359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854a61d-a9fe-428b-aae6-127a2b51edaa None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:29.177872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854a61d-a9fe-428b-aae6-127a2b51edaa None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:29.177984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854a61d-a9fe-428b-aae6-127a2b51edaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:29.196798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-8854a61d-a9fe-428b-aae6-127a2b51edaa None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:29.198028 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8854a61d-a9fe-428b-aae6-127a2b51edaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:29.255633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1170/2338] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:29.266224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:29.267645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:29.324808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3e52f-03a9-41b4-882b-93929945e0a9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:29.328321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93b474-da84-4ff5-858e-3493baa9bc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:29.328924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93b474-da84-4ff5-858e-3493baa9bc03 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:29.329204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93b474-da84-4ff5-858e-3493baa9bc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:29.329477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93b474-da84-4ff5-858e-3493baa9bc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:29.339293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93b474-da84-4ff5-858e-3493baa9bc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:29.341018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93b474-da84-4ff5-858e-3493baa9bc03 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:29.350565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1169/2339] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:29.856376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854a61d-a9fe-428b-aae6-127a2b51edaa None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:29.857844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8854a61d-a9fe-428b-aae6-127a2b51edaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:29.871939 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854a61d-a9fe-428b-aae6-127a2b51edaa None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:29.877233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:29.877930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:29.878210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:29.878487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] PATH_INFO: `/v3/projects/66d9049c15984fd59e0536dc745e1f41` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:29.879615 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d9049c15984fd59e0536dc745e1f41)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:29.881819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:30.001141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d9049c15984fd59e0536dc745e1f41', 'request_id': 'req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:30.008718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d9049c15984fd59e0536dc745e1f41', 'request_id': 'req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:30.094880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:30.158159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d9049c15984fd59e0536dc745e1f41', 'request_id': 'req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:30.170130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] The token cache is being invalidate because project 66d9049c15984fd59e0536dc745e1f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:30.170425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:30.171136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:30.172843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1171/2340] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:29 2022] DELETE /identity/v3/projects/66d9049c15984fd59e0536dc745e1f41 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:30.176589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93b474-da84-4ff5-858e-3493baa9bc03 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:30.187063 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93b474-da84-4ff5-858e-3493baa9bc03 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:30.243487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:30.244199 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:30.244482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:30.244759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] PATH_INFO: `/v3/users/df50a55b77d24c4fa27b136c1801cd81` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:30.245958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df50a55b77d24c4fa27b136c1801cd81)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:30.247928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:30.559646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df50a55b77d24c4fa27b136c1801cd81'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:30.704066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df50a55b77d24c4fa27b136c1801cd81'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:30.704694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df50a55b77d24c4fa27b136c1801cd81'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:30.718201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df50a55b77d24c4fa27b136c1801cd81'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:30.718866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-649bc59d-9ea1-49a9-8bd7-8248e73b7a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df50a55b77d24c4fa27b136c1801cd81'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:30.731476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1170/2341] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:30 2022] DELETE /identity/v3/users/df50a55b77d24c4fa27b136c1801cd81 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:31.191786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.193436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.208354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:31.211201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6808c-d181-43e2-ad7d-5cd36ddc6af8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.270797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.271428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.271704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.272131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] PATH_INFO: `/v3/projects/804ca6358e31414abd83e5cd210c2dd7` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.273387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=804ca6358e31414abd83e5cd210c2dd7)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.275713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.437981 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804ca6358e31414abd83e5cd210c2dd7', 'request_id': 'req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:31.444087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804ca6358e31414abd83e5cd210c2dd7', 'request_id': 'req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:31.540507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804ca6358e31414abd83e5cd210c2dd7', 'request_id': 'req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:31.552029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] The token cache is being invalidate because project 804ca6358e31414abd83e5cd210c2dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:31.552313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:31.553976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9b648d92-6b12-4a5d-bfaf-2a4dbc220cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:31.554463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1172/2342] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:31 2022] DELETE /identity/v3/projects/804ca6358e31414abd83e5cd210c2dd7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:31:31.559966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26951512-57ca-4151-b20c-6ec9ba527a02 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.560261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26951512-57ca-4151-b20c-6ec9ba527a02 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.560543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26951512-57ca-4151-b20c-6ec9ba527a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.580746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-26951512-57ca-4151-b20c-6ec9ba527a02 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.581996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-26951512-57ca-4151-b20c-6ec9ba527a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.642191 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1171/2343] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.650925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159c4c9-efbb-4643-835a-f131b8f54ae4 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.651212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159c4c9-efbb-4643-835a-f131b8f54ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.651495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159c4c9-efbb-4643-835a-f131b8f54ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.671490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1159c4c9-efbb-4643-835a-f131b8f54ae4 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:31.672695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1159c4c9-efbb-4643-835a-f131b8f54ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:31.681539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1173/2344] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:31.686607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26951512-57ca-4151-b20c-6ec9ba527a02 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.696316 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26951512-57ca-4151-b20c-6ec9ba527a02 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.700833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b80ce-cdc2-4b4c-9559-ca2a894661e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.701431 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b80ce-cdc2-4b4c-9559-ca2a894661e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.701748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b80ce-cdc2-4b4c-9559-ca2a894661e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.702028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b80ce-cdc2-4b4c-9559-ca2a894661e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.702679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b80ce-cdc2-4b4c-9559-ca2a894661e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:31.702986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b80ce-cdc2-4b4c-9559-ca2a894661e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.704611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b80ce-cdc2-4b4c-9559-ca2a894661e0 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.734128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1172/2345] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:31.734336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159c4c9-efbb-4643-835a-f131b8f54ae4 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.734336 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159c4c9-efbb-4643-835a-f131b8f54ae4 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.736077 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3affb-01b2-4ac4-8897-0cdffffc4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.736709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3affb-01b2-4ac4-8897-0cdffffc4b13 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.736997 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3affb-01b2-4ac4-8897-0cdffffc4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.737274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3affb-01b2-4ac4-8897-0cdffffc4b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.737959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3affb-01b2-4ac4-8897-0cdffffc4b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.739847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3affb-01b2-4ac4-8897-0cdffffc4b13 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:31.878974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1174/2346] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:31.883493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b80ce-cdc2-4b4c-9559-ca2a894661e0 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:31.893936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b80ce-cdc2-4b4c-9559-ca2a894661e0 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:31.951270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8d4d1-f28f-4d04-9c25-3e6e3636eb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:31.951877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8d4d1-f28f-4d04-9c25-3e6e3636eb36 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:31.952168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8d4d1-f28f-4d04-9c25-3e6e3636eb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:31.952455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8d4d1-f28f-4d04-9c25-3e6e3636eb36 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:31.953129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8d4d1-f28f-4d04-9c25-3e6e3636eb36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:31.955132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8d4d1-f28f-4d04-9c25-3e6e3636eb36 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.098847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1173/2347] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:31 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:32.103539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3affb-01b2-4ac4-8897-0cdffffc4b13 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.113824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3affb-01b2-4ac4-8897-0cdffffc4b13 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.118397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179951-7c9c-45ab-bed3-e5dc2e58acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.118922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179951-7c9c-45ab-bed3-e5dc2e58acbe admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.119203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179951-7c9c-45ab-bed3-e5dc2e58acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.119478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179951-7c9c-45ab-bed3-e5dc2e58acbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.120122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79179951-7c9c-45ab-bed3-e5dc2e58acbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.121738 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79179951-7c9c-45ab-bed3-e5dc2e58acbe admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.132185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1175/2348] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:32.136142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8d4d1-f28f-4d04-9c25-3e6e3636eb36 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.145991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8d4d1-f28f-4d04-9c25-3e6e3636eb36 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.151101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574061e-c71b-4f95-b9ec-162cf941f886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.151687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574061e-c71b-4f95-b9ec-162cf941f886 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.151967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574061e-c71b-4f95-b9ec-162cf941f886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.152238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574061e-c71b-4f95-b9ec-162cf941f886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.152869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574061e-c71b-4f95-b9ec-162cf941f886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.154485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574061e-c71b-4f95-b9ec-162cf941f886 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.165728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1174/2349] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:32.170005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179951-7c9c-45ab-bed3-e5dc2e58acbe admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.179900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179951-7c9c-45ab-bed3-e5dc2e58acbe admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.184409 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510cb4c-8f0b-4774-9da1-6f6190ba53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.185053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510cb4c-8f0b-4774-9da1-6f6190ba53f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.185331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510cb4c-8f0b-4774-9da1-6f6190ba53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.185605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510cb4c-8f0b-4774-9da1-6f6190ba53f3 admin admin] PATH_INFO: `/v3/projects/68fe73c6c51a4afeacfa203bebbd2233/users/a9d8ce5584704c1c91acfc75346ab4ef/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.199982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510cb4c-8f0b-4774-9da1-6f6190ba53f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fe73c6c51a4afeacfa203bebbd2233, user_id=a9d8ce5584704c1c91acfc75346ab4ef, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.202732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510cb4c-8f0b-4774-9da1-6f6190ba53f3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.289438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1176/2350] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:32 2022] PUT /identity/v3/projects/68fe73c6c51a4afeacfa203bebbd2233/users/a9d8ce5584704c1c91acfc75346ab4ef/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:32.299826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c88022-5492-44a3-9aea-8886449e42b0 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.300378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c88022-5492-44a3-9aea-8886449e42b0 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.300679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c88022-5492-44a3-9aea-8886449e42b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.311595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:32.333075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c6c88022-5492-44a3-9aea-8886449e42b0 None None] MFA Rules not processed for user `a9d8ce5584704c1c91acfc75346ab4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:32.334281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c6c88022-5492-44a3-9aea-8886449e42b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:32.403707 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1175/2351] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:32.409266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510cb4c-8f0b-4774-9da1-6f6190ba53f3 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.471319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510cb4c-8f0b-4774-9da1-6f6190ba53f3 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.476168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c51773-df50-40cf-87bf-fd26bc2cb74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.476772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c51773-df50-40cf-87bf-fd26bc2cb74d admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.477049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c51773-df50-40cf-87bf-fd26bc2cb74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.477322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c51773-df50-40cf-87bf-fd26bc2cb74d admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.478000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c51773-df50-40cf-87bf-fd26bc2cb74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.479893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c51773-df50-40cf-87bf-fd26bc2cb74d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.483581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:32.621719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1177/2352] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:32 2022] POST /identity/v3/projects => generated 367 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:32.624923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c88022-5492-44a3-9aea-8886449e42b0 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.636293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c88022-5492-44a3-9aea-8886449e42b0 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.693957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9b40e-c7a7-46b9-8684-2d8ca27e29f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.694562 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9b40e-c7a7-46b9-8684-2d8ca27e29f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.694845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9b40e-c7a7-46b9-8684-2d8ca27e29f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.695272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9b40e-c7a7-46b9-8684-2d8ca27e29f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.696493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9b40e-c7a7-46b9-8684-2d8ca27e29f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.698486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9b40e-c7a7-46b9-8684-2d8ca27e29f5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.872391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1176/2353] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:32 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:32.876551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c51773-df50-40cf-87bf-fd26bc2cb74d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.887640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c51773-df50-40cf-87bf-fd26bc2cb74d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.892394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721652e-6976-4f97-8354-3c72c975845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.892992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721652e-6976-4f97-8354-3c72c975845d admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.893268 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721652e-6976-4f97-8354-3c72c975845d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.893543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721652e-6976-4f97-8354-3c72c975845d admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.894252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721652e-6976-4f97-8354-3c72c975845d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.895851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721652e-6976-4f97-8354-3c72c975845d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:32.906431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1178/2354] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:32.910707 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9b40e-c7a7-46b9-8684-2d8ca27e29f5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:32.921113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9b40e-c7a7-46b9-8684-2d8ca27e29f5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:32.925848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e6628-dbb6-4c96-9343-8a9936722ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:32.926499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e6628-dbb6-4c96-9343-8a9936722ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:32.926773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e6628-dbb6-4c96-9343-8a9936722ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:32.927055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e6628-dbb6-4c96-9343-8a9936722ea1 admin admin] PATH_INFO: `/v3/projects/e8f791a22b934c08befb03ee4a7483a4/users/120d7e287229416e996efbe64abc4bca/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:32.942302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e6628-dbb6-4c96-9343-8a9936722ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f791a22b934c08befb03ee4a7483a4, user_id=120d7e287229416e996efbe64abc4bca, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:32.944956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e6628-dbb6-4c96-9343-8a9936722ea1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.055802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1177/2355] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:32 2022] PUT /identity/v3/projects/e8f791a22b934c08befb03ee4a7483a4/users/120d7e287229416e996efbe64abc4bca/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:31:33.060334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721652e-6976-4f97-8354-3c72c975845d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.070475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721652e-6976-4f97-8354-3c72c975845d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.130735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebffe8d-6fff-4df3-8f3f-445ea017121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.131381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebffe8d-6fff-4df3-8f3f-445ea017121f admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.131660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebffe8d-6fff-4df3-8f3f-445ea017121f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.131936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebffe8d-6fff-4df3-8f3f-445ea017121f admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.132578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebffe8d-6fff-4df3-8f3f-445ea017121f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.134263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebffe8d-6fff-4df3-8f3f-445ea017121f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.144223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1179/2356] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:33.148556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e6628-dbb6-4c96-9343-8a9936722ea1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.162443 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e6628-dbb6-4c96-9343-8a9936722ea1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.168098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901b7d-2bae-4e35-ac87-065609d5b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.170244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901b7d-2bae-4e35-ac87-065609d5b75f admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.170244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901b7d-2bae-4e35-ac87-065609d5b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.170244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c901b7d-2bae-4e35-ac87-065609d5b75f admin admin] PATH_INFO: `/v3/projects/e8f791a22b934c08befb03ee4a7483a4/users/120d7e287229416e996efbe64abc4bca/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.171529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c901b7d-2bae-4e35-ac87-065609d5b75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f791a22b934c08befb03ee4a7483a4, user_id=120d7e287229416e996efbe64abc4bca, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.174319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c901b7d-2bae-4e35-ac87-065609d5b75f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.186981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1178/2357] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:33 2022] PUT /identity/v3/projects/e8f791a22b934c08befb03ee4a7483a4/users/120d7e287229416e996efbe64abc4bca/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:31:33.199187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6102-197a-4bab-bc24-dce32ebb0851 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.199573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6102-197a-4bab-bc24-dce32ebb0851 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.199932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6102-197a-4bab-bc24-dce32ebb0851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.233649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-6eda6102-197a-4bab-bc24-dce32ebb0851 None None] MFA Rules not processed for user `120d7e287229416e996efbe64abc4bca`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:33.235494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6eda6102-197a-4bab-bc24-dce32ebb0851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:33.313863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1180/2358] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:33.326071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901b7d-2bae-4e35-ac87-065609d5b75f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.327876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9c901b7d-2bae-4e35-ac87-065609d5b75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:33.389601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c901b7d-2bae-4e35-ac87-065609d5b75f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.394047 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401062b2-ba93-4c51-a7f4-4ee3b1b99fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.394672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401062b2-ba93-4c51-a7f4-4ee3b1b99fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.394963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401062b2-ba93-4c51-a7f4-4ee3b1b99fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.395267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401062b2-ba93-4c51-a7f4-4ee3b1b99fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.404890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401062b2-ba93-4c51-a7f4-4ee3b1b99fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.406376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401062b2-ba93-4c51-a7f4-4ee3b1b99fb7 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.416091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1179/2359] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:33.841214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda6102-197a-4bab-bc24-dce32ebb0851 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:33.850917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda6102-197a-4bab-bc24-dce32ebb0851 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:33.855107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78329fb1-902b-4bb4-885c-d883db2bce30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:33.855723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78329fb1-902b-4bb4-885c-d883db2bce30 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:33.855996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78329fb1-902b-4bb4-885c-d883db2bce30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:33.856273 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78329fb1-902b-4bb4-885c-d883db2bce30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:33.916143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78329fb1-902b-4bb4-885c-d883db2bce30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:33.917506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78329fb1-902b-4bb4-885c-d883db2bce30 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:33.926469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1181/2360] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:34.203779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:34.671889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:36.117855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:37.452974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:37.986284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:38.540897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:39.374754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:39.929340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:40.182013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:41.751845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:42.003965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401062b2-ba93-4c51-a7f4-4ee3b1b99fb7 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:42.005400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-401062b2-ba93-4c51-a7f4-4ee3b1b99fb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:42.062600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401062b2-ba93-4c51-a7f4-4ee3b1b99fb7 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:42.066230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569edc58-1313-4dc7-94ab-f2609bdb7d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:42.066842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569edc58-1313-4dc7-94ab-f2609bdb7d1c service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:42.067261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569edc58-1313-4dc7-94ab-f2609bdb7d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:42.067382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569edc58-1313-4dc7-94ab-f2609bdb7d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:42.069111 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-569edc58-1313-4dc7-94ab-f2609bdb7d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:42.131752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569edc58-1313-4dc7-94ab-f2609bdb7d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:42.133739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569edc58-1313-4dc7-94ab-f2609bdb7d1c service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:42.143087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1180/2361] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:42.215427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:42.379843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78329fb1-902b-4bb4-885c-d883db2bce30 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:42.450326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78329fb1-902b-4bb4-885c-d883db2bce30 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:42.455292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:42.455938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:42.456218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:42.456491 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] PATH_INFO: `/v3/users/a9d8ce5584704c1c91acfc75346ab4ef` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:42.459093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d8ce5584704c1c91acfc75346ab4ef)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:42.459649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:42.716619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d8ce5584704c1c91acfc75346ab4ef'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:42.717285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d8ce5584704c1c91acfc75346ab4ef'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:42.717960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d8ce5584704c1c91acfc75346ab4ef'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:42.849114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d8ce5584704c1c91acfc75346ab4ef'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:42.868058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d8ce5584704c1c91acfc75346ab4ef'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:42.883679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1182/2362] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:42 2022] DELETE /identity/v3/users/a9d8ce5584704c1c91acfc75346ab4ef => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:42.888444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6068c7-52d9-4ba2-b443-1af0111b9adb None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:42.888912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6068c7-52d9-4ba2-b443-1af0111b9adb None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:42.889007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6068c7-52d9-4ba2-b443-1af0111b9adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:42.908939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-7d6068c7-52d9-4ba2-b443-1af0111b9adb None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:42.910313 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7d6068c7-52d9-4ba2-b443-1af0111b9adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:42.971130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1181/2363] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:42.980972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:42.982423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:43.041157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6a5a2-66a8-4076-b390-94fd7da02515 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:43.045111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b7531-d342-40c6-99f9-aa95b86fdfa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:43.045775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7531-d342-40c6-99f9-aa95b86fdfa7 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:43.046055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7531-d342-40c6-99f9-aa95b86fdfa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:43.046330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b7531-d342-40c6-99f9-aa95b86fdfa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:43.056609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b7531-d342-40c6-99f9-aa95b86fdfa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:43.058131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b7531-d342-40c6-99f9-aa95b86fdfa7 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:43.068559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1183/2364] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:43.117802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:43.720459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6068c7-52d9-4ba2-b443-1af0111b9adb None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:43.722013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7d6068c7-52d9-4ba2-b443-1af0111b9adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:43.745696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6068c7-52d9-4ba2-b443-1af0111b9adb None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:43.766859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:43.766859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:43.766859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:43.766859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] PATH_INFO: `/v3/projects/68fe73c6c51a4afeacfa203bebbd2233` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:43.767294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fe73c6c51a4afeacfa203bebbd2233)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:43.767294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:44.701622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fe73c6c51a4afeacfa203bebbd2233', 'request_id': 'req-7d51c631-fb93-44ed-a556-8ad6f31c7b51'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:44.708314 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fe73c6c51a4afeacfa203bebbd2233', 'request_id': 'req-7d51c631-fb93-44ed-a556-8ad6f31c7b51'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:44.820641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fe73c6c51a4afeacfa203bebbd2233', 'request_id': 'req-7d51c631-fb93-44ed-a556-8ad6f31c7b51'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:44.832836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] The token cache is being invalidate because project 68fe73c6c51a4afeacfa203bebbd2233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:44.833208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:44.833933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:44.835510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1182/2365] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:43 2022] DELETE /identity/v3/projects/68fe73c6c51a4afeacfa203bebbd2233 => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:44.840065 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b7531-d342-40c6-99f9-aa95b86fdfa7 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:44.851427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b7531-d342-40c6-99f9-aa95b86fdfa7 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:44.909378 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:44.910236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:44.910611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:44.910989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] PATH_INFO: `/v3/users/120d7e287229416e996efbe64abc4bca` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:44.912240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=120d7e287229416e996efbe64abc4bca)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:44.914930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:45.135620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120d7e287229416e996efbe64abc4bca'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:45.136425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120d7e287229416e996efbe64abc4bca'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:45.137158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120d7e287229416e996efbe64abc4bca'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:45.226756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120d7e287229416e996efbe64abc4bca'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:45.253545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-5f34a27a-5ab1-4ad1-bd20-b7b8e8ae34e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120d7e287229416e996efbe64abc4bca'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:45.265112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1184/2366] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:44 2022] DELETE /identity/v3/users/120d7e287229416e996efbe64abc4bca => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:45.621755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:45.781176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:45.783235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:45.810272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51c631-fb93-44ed-a556-8ad6f31c7b51 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:45.886104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:45.918976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:45.928103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:45.928103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:45.928103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] PATH_INFO: `/v3/projects/e8f791a22b934c08befb03ee4a7483a4` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:45.928103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f791a22b934c08befb03ee4a7483a4)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:45.928103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:46.092407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f791a22b934c08befb03ee4a7483a4', 'request_id': 'req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:46.099853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f791a22b934c08befb03ee4a7483a4', 'request_id': 'req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:46.209492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f791a22b934c08befb03ee4a7483a4', 'request_id': 'req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:46.222149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] The token cache is being invalidate because project e8f791a22b934c08befb03ee4a7483a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:46.222440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:46.223093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-bed3924d-beb9-4587-9d0c-d55edfd2d0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:46.224880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1183/2367] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:45 2022] DELETE /identity/v3/projects/e8f791a22b934c08befb03ee4a7483a4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:46.230298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5568ab8-4dbe-4b53-a19e-a5da6a14a532 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:46.231193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5568ab8-4dbe-4b53-a19e-a5da6a14a532 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:46.231554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5568ab8-4dbe-4b53-a19e-a5da6a14a532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:46.253480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-f5568ab8-4dbe-4b53-a19e-a5da6a14a532 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:46.260497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f5568ab8-4dbe-4b53-a19e-a5da6a14a532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:46.326004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1185/2368] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:46.327719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad50c6-dba7-4ea9-9c8b-67bf3d83f948 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:46.328011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad50c6-dba7-4ea9-9c8b-67bf3d83f948 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:46.328321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad50c6-dba7-4ea9-9c8b-67bf3d83f948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:46.350891 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-52ad50c6-dba7-4ea9-9c8b-67bf3d83f948 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:46.352762 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-52ad50c6-dba7-4ea9-9c8b-67bf3d83f948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:46.370398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1184/2369] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:46.380509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5568ab8-4dbe-4b53-a19e-a5da6a14a532 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:46.400420 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5568ab8-4dbe-4b53-a19e-a5da6a14a532 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:46.405717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046a25-2cbb-48a5-8d5a-c7255eb1ade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:46.407291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046a25-2cbb-48a5-8d5a-c7255eb1ade8 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:46.408289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046a25-2cbb-48a5-8d5a-c7255eb1ade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:46.408674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046a25-2cbb-48a5-8d5a-c7255eb1ade8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:46.410882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37046a25-2cbb-48a5-8d5a-c7255eb1ade8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:46.411404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37046a25-2cbb-48a5-8d5a-c7255eb1ade8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:46.413290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37046a25-2cbb-48a5-8d5a-c7255eb1ade8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:46.431423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1186/2370] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:31:46.435568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad50c6-dba7-4ea9-9c8b-67bf3d83f948 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:46.445875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad50c6-dba7-4ea9-9c8b-67bf3d83f948 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:46.465943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67ee37-5048-48dc-be74-fcd27463ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:46.466589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67ee37-5048-48dc-be74-fcd27463ee46 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:46.466894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67ee37-5048-48dc-be74-fcd27463ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:46.467159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67ee37-5048-48dc-be74-fcd27463ee46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:46.467817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67ee37-5048-48dc-be74-fcd27463ee46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:46.469801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67ee37-5048-48dc-be74-fcd27463ee46 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:46.704234 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1185/2371] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:46 2022] POST /identity/v3/projects => generated 379 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:46.705434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046a25-2cbb-48a5-8d5a-c7255eb1ade8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:46.717133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046a25-2cbb-48a5-8d5a-c7255eb1ade8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:46.787790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b02d5e-1068-413d-9478-350cb9a3e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:46.788422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b02d5e-1068-413d-9478-350cb9a3e7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:46.788681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b02d5e-1068-413d-9478-350cb9a3e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:46.788954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b02d5e-1068-413d-9478-350cb9a3e7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:46.789617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b02d5e-1068-413d-9478-350cb9a3e7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:46.791584 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b02d5e-1068-413d-9478-350cb9a3e7d2 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:46.928278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:46.934802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1187/2372] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:46 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:46.939006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67ee37-5048-48dc-be74-fcd27463ee46 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:46.949544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67ee37-5048-48dc-be74-fcd27463ee46 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:46.954188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb4152-c7f8-428a-88f8-7cc45f13d0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:46.954782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb4152-c7f8-428a-88f8-7cc45f13d0de admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:46.955065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb4152-c7f8-428a-88f8-7cc45f13d0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:46.955338 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb4152-c7f8-428a-88f8-7cc45f13d0de admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:46.955973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb4152-c7f8-428a-88f8-7cc45f13d0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:46.957549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb4152-c7f8-428a-88f8-7cc45f13d0de admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:46.967822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1186/2373] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:46.971804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b02d5e-1068-413d-9478-350cb9a3e7d2 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:46.981958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b02d5e-1068-413d-9478-350cb9a3e7d2 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:46.987044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fedde5-0ba6-4225-bf3c-036b5e52c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:46.987676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fedde5-0ba6-4225-bf3c-036b5e52c565 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:46.987968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fedde5-0ba6-4225-bf3c-036b5e52c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:46.988277 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fedde5-0ba6-4225-bf3c-036b5e52c565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:46.988868 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fedde5-0ba6-4225-bf3c-036b5e52c565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:46.990481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fedde5-0ba6-4225-bf3c-036b5e52c565 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:47.001889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1188/2374] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:47.006125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb4152-c7f8-428a-88f8-7cc45f13d0de admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:47.016757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb4152-c7f8-428a-88f8-7cc45f13d0de admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:47.021975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243030f-2036-46e2-8787-85038ecead4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:47.022672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243030f-2036-46e2-8787-85038ecead4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:47.022993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243030f-2036-46e2-8787-85038ecead4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:47.023302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243030f-2036-46e2-8787-85038ecead4f admin admin] PATH_INFO: `/v3/projects/315d4cf7bfda4b6a8ea49ff800272f0a/users/3b5cc9de2b1942078ff98ec9b9f8484d/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:47.039724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243030f-2036-46e2-8787-85038ecead4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=315d4cf7bfda4b6a8ea49ff800272f0a, user_id=3b5cc9de2b1942078ff98ec9b9f8484d, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:47.042634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243030f-2036-46e2-8787-85038ecead4f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:47.197616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1187/2375] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:47 2022] PUT /identity/v3/projects/315d4cf7bfda4b6a8ea49ff800272f0a/users/3b5cc9de2b1942078ff98ec9b9f8484d/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:31:47.209147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04707e5d-f3e8-4adb-99df-885adf7c62e1 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:47.209891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04707e5d-f3e8-4adb-99df-885adf7c62e1 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:47.211327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04707e5d-f3e8-4adb-99df-885adf7c62e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:47.241731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-04707e5d-f3e8-4adb-99df-885adf7c62e1 None None] MFA Rules not processed for user `3b5cc9de2b1942078ff98ec9b9f8484d`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:47.243528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-04707e5d-f3e8-4adb-99df-885adf7c62e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:47.307469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1189/2376] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:47.312027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243030f-2036-46e2-8787-85038ecead4f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:47.377658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243030f-2036-46e2-8787-85038ecead4f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:47.382330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dcec4-8e20-42f7-abeb-d701e6d19de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:47.393259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dcec4-8e20-42f7-abeb-d701e6d19de9 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:47.393259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dcec4-8e20-42f7-abeb-d701e6d19de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:47.393259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dcec4-8e20-42f7-abeb-d701e6d19de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:47.393259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dcec4-8e20-42f7-abeb-d701e6d19de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:47.393259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dcec4-8e20-42f7-abeb-d701e6d19de9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:47.538613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1188/2377] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:47 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:47.540661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04707e5d-f3e8-4adb-99df-885adf7c62e1 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:47.552237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04707e5d-f3e8-4adb-99df-885adf7c62e1 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:47.628474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ec2ef-1968-4b63-8449-31043b6bac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:47.634103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ec2ef-1968-4b63-8449-31043b6bac49 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:47.634103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ec2ef-1968-4b63-8449-31043b6bac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:47.634103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ec2ef-1968-4b63-8449-31043b6bac49 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:47.634103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ec2ef-1968-4b63-8449-31043b6bac49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:47.634103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ec2ef-1968-4b63-8449-31043b6bac49 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:47.821396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1190/2378] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:47 2022] POST /identity/v3/users => generated 296 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:47.825442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dcec4-8e20-42f7-abeb-d701e6d19de9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:47.836850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dcec4-8e20-42f7-abeb-d701e6d19de9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:47.841842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e17ab6-e1f3-4ddd-8493-747c0d100145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:47.842444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e17ab6-e1f3-4ddd-8493-747c0d100145 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:47.842724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e17ab6-e1f3-4ddd-8493-747c0d100145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:47.842998 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e17ab6-e1f3-4ddd-8493-747c0d100145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:47.843643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e17ab6-e1f3-4ddd-8493-747c0d100145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:47.845331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e17ab6-e1f3-4ddd-8493-747c0d100145 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:47.856875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1189/2379] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:47.861221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ec2ef-1968-4b63-8449-31043b6bac49 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:47.871960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ec2ef-1968-4b63-8449-31043b6bac49 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:47.877088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9c526-f7fa-47eb-b599-533191b03f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:47.877910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9c526-f7fa-47eb-b599-533191b03f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:47.878374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9c526-f7fa-47eb-b599-533191b03f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:47.878653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9c526-f7fa-47eb-b599-533191b03f1e admin admin] PATH_INFO: `/v3/projects/532c69c2a6c6407a8733dce61d93cc90/users/cfec6d00021b4bfab75098edf2b0092b/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:47.895866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9c526-f7fa-47eb-b599-533191b03f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=532c69c2a6c6407a8733dce61d93cc90, user_id=cfec6d00021b4bfab75098edf2b0092b, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:47.899080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9c526-f7fa-47eb-b599-533191b03f1e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:48.076110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1191/2380] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:47 2022] PUT /identity/v3/projects/532c69c2a6c6407a8733dce61d93cc90/users/cfec6d00021b4bfab75098edf2b0092b/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:48.083619 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e17ab6-e1f3-4ddd-8493-747c0d100145 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:48.095301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e17ab6-e1f3-4ddd-8493-747c0d100145 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:48.161232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec54ab4-299e-4252-9d2c-1fc3894f405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:48.161232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec54ab4-299e-4252-9d2c-1fc3894f405c admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:48.161232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec54ab4-299e-4252-9d2c-1fc3894f405c admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:48.161232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec54ab4-299e-4252-9d2c-1fc3894f405c admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:48.161723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec54ab4-299e-4252-9d2c-1fc3894f405c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:48.161723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec54ab4-299e-4252-9d2c-1fc3894f405c admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:48.170585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1190/2381] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:48.172026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9c526-f7fa-47eb-b599-533191b03f1e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:48.182910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9c526-f7fa-47eb-b599-533191b03f1e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:48.187990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6347be-75b8-4869-ad28-4a2ba2097063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:48.188659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6347be-75b8-4869-ad28-4a2ba2097063 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:48.188944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6347be-75b8-4869-ad28-4a2ba2097063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:48.189223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6347be-75b8-4869-ad28-4a2ba2097063 admin admin] PATH_INFO: `/v3/projects/532c69c2a6c6407a8733dce61d93cc90/users/cfec6d00021b4bfab75098edf2b0092b/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:48.191301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6347be-75b8-4869-ad28-4a2ba2097063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532c69c2a6c6407a8733dce61d93cc90, user_id=cfec6d00021b4bfab75098edf2b0092b, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:48.194181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6347be-75b8-4869-ad28-4a2ba2097063 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:48.206675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1192/2382] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:48 2022] PUT /identity/v3/projects/532c69c2a6c6407a8733dce61d93cc90/users/cfec6d00021b4bfab75098edf2b0092b/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:48.219391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b65af7-4e4f-4d5b-bbca-749495f37b26 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:48.227485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b65af7-4e4f-4d5b-bbca-749495f37b26 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:48.227913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b65af7-4e4f-4d5b-bbca-749495f37b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:48.263729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-66b65af7-4e4f-4d5b-bbca-749495f37b26 None None] MFA Rules not processed for user `cfec6d00021b4bfab75098edf2b0092b`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:48.263729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-66b65af7-4e4f-4d5b-bbca-749495f37b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:48.339511 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1191/2383] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:48.350783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6347be-75b8-4869-ad28-4a2ba2097063 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:48.352541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2a6347be-75b8-4869-ad28-4a2ba2097063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:48.411177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6347be-75b8-4869-ad28-4a2ba2097063 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:48.414817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c335ce-17c8-489e-b89a-de849ae7bfdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:48.415417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c335ce-17c8-489e-b89a-de849ae7bfdb service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:48.415695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c335ce-17c8-489e-b89a-de849ae7bfdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:48.415965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c335ce-17c8-489e-b89a-de849ae7bfdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:48.424940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c335ce-17c8-489e-b89a-de849ae7bfdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:48.426509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c335ce-17c8-489e-b89a-de849ae7bfdb service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:48.436918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1193/2384] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:48.438310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:49.108955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b65af7-4e4f-4d5b-bbca-749495f37b26 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:49.180564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b65af7-4e4f-4d5b-bbca-749495f37b26 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:49.185270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:49.190393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:49.190393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:49.190393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] PATH_INFO: `/v3/users/3b5cc9de2b1942078ff98ec9b9f8484d` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:49.190393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5cc9de2b1942078ff98ec9b9f8484d)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:49.190393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:49.411272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5cc9de2b1942078ff98ec9b9f8484d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.482634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5cc9de2b1942078ff98ec9b9f8484d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.483648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5cc9de2b1942078ff98ec9b9f8484d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.494945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:49.505458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5cc9de2b1942078ff98ec9b9f8484d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.506627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5cc9de2b1942078ff98ec9b9f8484d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:49.521653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1192/2385] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:49 2022] DELETE /identity/v3/users/3b5cc9de2b1942078ff98ec9b9f8484d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:49.526551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ee3a1-cec3-4af8-9930-7526d110836a None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:49.527411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ee3a1-cec3-4af8-9930-7526d110836a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:49.527695 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ee3a1-cec3-4af8-9930-7526d110836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:49.550099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-0b5ee3a1-cec3-4af8-9930-7526d110836a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:49.551633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0b5ee3a1-cec3-4af8-9930-7526d110836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:49.621387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1194/2386] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:49.628417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:49.629970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:49.713384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb72c58-5359-49a8-a49b-3c3aa60e3a95 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:49.719042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1fa5-d4a9-43c9-9cd0-46a5138f1514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:49.719694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1fa5-d4a9-43c9-9cd0-46a5138f1514 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:49.719977 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1fa5-d4a9-43c9-9cd0-46a5138f1514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:49.720343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1fa5-d4a9-43c9-9cd0-46a5138f1514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:49.732126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a1fa5-d4a9-43c9-9cd0-46a5138f1514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:49.733575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a1fa5-d4a9-43c9-9cd0-46a5138f1514 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:49.743958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1193/2387] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:31:50.414103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ee3a1-cec3-4af8-9930-7526d110836a None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:50.415972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0b5ee3a1-cec3-4af8-9930-7526d110836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:50.429617 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ee3a1-cec3-4af8-9930-7526d110836a None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:50.436920 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:50.438125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:50.438653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:50.439195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] PATH_INFO: `/v3/projects/315d4cf7bfda4b6a8ea49ff800272f0a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:50.440645 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] RBAC: Authorizing `identity:delete_project(project_id=315d4cf7bfda4b6a8ea49ff800272f0a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:50.442996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:50.563637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:50.627772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315d4cf7bfda4b6a8ea49ff800272f0a', 'request_id': 'req-f36cdcce-05b6-42b7-aab5-91d487fbd55c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:50.634605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315d4cf7bfda4b6a8ea49ff800272f0a', 'request_id': 'req-f36cdcce-05b6-42b7-aab5-91d487fbd55c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:50.718712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315d4cf7bfda4b6a8ea49ff800272f0a', 'request_id': 'req-f36cdcce-05b6-42b7-aab5-91d487fbd55c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:50.732143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] The token cache is being invalidate because project 315d4cf7bfda4b6a8ea49ff800272f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:50.732426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:50.733125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:50.734752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1195/2388] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:50 2022] DELETE /identity/v3/projects/315d4cf7bfda4b6a8ea49ff800272f0a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:50.738720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1fa5-d4a9-43c9-9cd0-46a5138f1514 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:50.749335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1fa5-d4a9-43c9-9cd0-46a5138f1514 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:50.817246 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:50.818700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:50.822593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:50.822593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] PATH_INFO: `/v3/users/cfec6d00021b4bfab75098edf2b0092b` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:50.822593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfec6d00021b4bfab75098edf2b0092b)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:50.823512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:51.039072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfec6d00021b4bfab75098edf2b0092b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:51.106114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfec6d00021b4bfab75098edf2b0092b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:51.106753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfec6d00021b4bfab75098edf2b0092b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:51.120025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfec6d00021b4bfab75098edf2b0092b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:51.120765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-7aff665c-4de4-47d9-a2c5-95b7e16c4742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfec6d00021b4bfab75098edf2b0092b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:51.133647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1194/2389] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:31:50 2022] DELETE /identity/v3/users/cfec6d00021b4bfab75098edf2b0092b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:51.448104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:51.543434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:51.546541 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:51.557902 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cdcce-05b6-42b7-aab5-91d487fbd55c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:51.617719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:51.618398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:51.618398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:51.618398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] PATH_INFO: `/v3/projects/532c69c2a6c6407a8733dce61d93cc90` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:51.619471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532c69c2a6c6407a8733dce61d93cc90)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:51.621410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:51.739480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532c69c2a6c6407a8733dce61d93cc90', 'request_id': 'req-3b6a8bd6-d989-408f-8103-53a43b715b48'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:51.745503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532c69c2a6c6407a8733dce61d93cc90', 'request_id': 'req-3b6a8bd6-d989-408f-8103-53a43b715b48'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:51.826063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532c69c2a6c6407a8733dce61d93cc90', 'request_id': 'req-3b6a8bd6-d989-408f-8103-53a43b715b48'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:51.838542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] The token cache is being invalidate because project 532c69c2a6c6407a8733dce61d93cc90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:31:51.838773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:51.839409 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3b6a8bd6-d989-408f-8103-53a43b715b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:31:51.841483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1196/2390] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:31:51 2022] DELETE /identity/v3/projects/532c69c2a6c6407a8733dce61d93cc90 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:51.847515 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62044f81-4e51-4183-b65c-870ae906ba66 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:51.847515 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62044f81-4e51-4183-b65c-870ae906ba66 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:51.847515 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62044f81-4e51-4183-b65c-870ae906ba66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:51.866946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-62044f81-4e51-4183-b65c-870ae906ba66 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:51.868271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-62044f81-4e51-4183-b65c-870ae906ba66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:51.930243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1195/2391] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:51.937917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf7c54-7a20-4cf6-b6b8-42df0ec181ed None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:51.938206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf7c54-7a20-4cf6-b6b8-42df0ec181ed None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:51.938492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf7c54-7a20-4cf6-b6b8-42df0ec181ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:51.958736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-44bf7c54-7a20-4cf6-b6b8-42df0ec181ed None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:51.959959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-44bf7c54-7a20-4cf6-b6b8-42df0ec181ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:51.969092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1197/2392] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:51.978818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62044f81-4e51-4183-b65c-870ae906ba66 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:51.988671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62044f81-4e51-4183-b65c-870ae906ba66 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:51.993436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a65257-3e0a-4be1-841f-f80ec3249667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:51.994082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a65257-3e0a-4be1-841f-f80ec3249667 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:51.994371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a65257-3e0a-4be1-841f-f80ec3249667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:51.994680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a65257-3e0a-4be1-841f-f80ec3249667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:51.995334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a65257-3e0a-4be1-841f-f80ec3249667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:31:51.995643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a65257-3e0a-4be1-841f-f80ec3249667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:51.997238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a65257-3e0a-4be1-841f-f80ec3249667 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:52.010135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1196/2393] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:31:52.014636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf7c54-7a20-4cf6-b6b8-42df0ec181ed None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:52.024589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf7c54-7a20-4cf6-b6b8-42df0ec181ed None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:52.029213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98cccb-9139-46e6-927b-faed0def30b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:52.029908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98cccb-9139-46e6-927b-faed0def30b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.030189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98cccb-9139-46e6-927b-faed0def30b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.030462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98cccb-9139-46e6-927b-faed0def30b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.031124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98cccb-9139-46e6-927b-faed0def30b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:52.033081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98cccb-9139-46e6-927b-faed0def30b8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:52.129612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1198/2394] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:31:52 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:52.134487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a65257-3e0a-4be1-841f-f80ec3249667 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:52.144554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a65257-3e0a-4be1-841f-f80ec3249667 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:52.201264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648315f7-a0c2-49c7-b9fa-781306dad0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:52.201909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648315f7-a0c2-49c7-b9fa-781306dad0be admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.202228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648315f7-a0c2-49c7-b9fa-781306dad0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.202511 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648315f7-a0c2-49c7-b9fa-781306dad0be admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.203151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648315f7-a0c2-49c7-b9fa-781306dad0be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:52.205094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648315f7-a0c2-49c7-b9fa-781306dad0be admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:52.238233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:52.361220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1197/2395] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:31:52 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:31:52.362386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98cccb-9139-46e6-927b-faed0def30b8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:52.374309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98cccb-9139-46e6-927b-faed0def30b8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:52.380657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fed55-d5a4-4fc5-beb8-a3d3aa2f9b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:52.381429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fed55-d5a4-4fc5-beb8-a3d3aa2f9b7b admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.388438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fed55-d5a4-4fc5-beb8-a3d3aa2f9b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.388438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fed55-d5a4-4fc5-beb8-a3d3aa2f9b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.388438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fed55-d5a4-4fc5-beb8-a3d3aa2f9b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:52.388438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fed55-d5a4-4fc5-beb8-a3d3aa2f9b7b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:52.396883 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1199/2396] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:31:52.400938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648315f7-a0c2-49c7-b9fa-781306dad0be admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:52.411425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648315f7-a0c2-49c7-b9fa-781306dad0be admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:52.416352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5b2d2-9a12-44f6-8220-f67249cce120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:52.418804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b2d2-9a12-44f6-8220-f67249cce120 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.418804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b2d2-9a12-44f6-8220-f67249cce120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.418804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b2d2-9a12-44f6-8220-f67249cce120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.418804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5b2d2-9a12-44f6-8220-f67249cce120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:52.419834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5b2d2-9a12-44f6-8220-f67249cce120 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:52.432026 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1198/2397] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:31:52.436320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fed55-d5a4-4fc5-beb8-a3d3aa2f9b7b admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:52.447032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fed55-d5a4-4fc5-beb8-a3d3aa2f9b7b admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:52.452046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3e75-b6e0-4628-8fe2-d5ef029a65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:52.452696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3e75-b6e0-4628-8fe2-d5ef029a65e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.453099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3e75-b6e0-4628-8fe2-d5ef029a65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.453402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3e75-b6e0-4628-8fe2-d5ef029a65e5 admin admin] PATH_INFO: `/v3/projects/d0fae81b04f742b99b6b3a6f6bf7cfea/users/c3cdc3d06b474bb6a63362d0e884a404/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.468942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3e75-b6e0-4628-8fe2-d5ef029a65e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fae81b04f742b99b6b3a6f6bf7cfea, user_id=c3cdc3d06b474bb6a63362d0e884a404, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:52.471729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3e75-b6e0-4628-8fe2-d5ef029a65e5 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:52.626520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1200/2398] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:31:52 2022] PUT /identity/v3/projects/d0fae81b04f742b99b6b3a6f6bf7cfea/users/c3cdc3d06b474bb6a63362d0e884a404/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:31:52.637757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ecaf7-c8fe-47db-9b61-07b1d9e65128 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.642428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ecaf7-c8fe-47db-9b61-07b1d9e65128 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.642428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ecaf7-c8fe-47db-9b61-07b1d9e65128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.665624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-043ecaf7-c8fe-47db-9b61-07b1d9e65128 None None] MFA Rules not processed for user `c3cdc3d06b474bb6a63362d0e884a404`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:52.666868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-043ecaf7-c8fe-47db-9b61-07b1d9e65128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:52.731525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1199/2399] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:31:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:52.747969 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3e75-b6e0-4628-8fe2-d5ef029a65e5 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:52.749843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3cea3e75-b6e0-4628-8fe2-d5ef029a65e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:52.807104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3e75-b6e0-4628-8fe2-d5ef029a65e5 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:52.811058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c5f79-53e3-4766-b5c0-14a819c5c049 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f14e5614aee44c59a47b12e5b35ea3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:52.811819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c5f79-53e3-4766-b5c0-14a819c5c049 service glance] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:52.812615 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c5f79-53e3-4766-b5c0-14a819c5c049 service glance] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:52.812615 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c5f79-53e3-4766-b5c0-14a819c5c049 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:52.824333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c5f79-53e3-4766-b5c0-14a819c5c049 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:52.825875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c5f79-53e3-4766-b5c0-14a819c5c049 service glance] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:52.837044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1201/2400] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:53.181224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:54.272723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:54.420800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:55.157900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:55.391952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:55.912575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:56.379598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:56.552814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:57.159879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:57.329646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:57.884309 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:58.025895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:58.396956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:58.672555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:59.112318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:59.246467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea924d-a574-4680-b518-0023055e23bf None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:59.246889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea924d-a574-4680-b518-0023055e23bf None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:59.247084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea924d-a574-4680-b518-0023055e23bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:59.267447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-f2ea924d-a574-4680-b518-0023055e23bf None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:31:59.268665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f2ea924d-a574-4680-b518-0023055e23bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:59.295132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:59.327575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1200/2401] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:31:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:31:59.351486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c5f79-53e3-4766-b5c0-14a819c5c049 service glance] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:59.352978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f30c5f79-53e3-4766-b5c0-14a819c5c049 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:59.428172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c5f79-53e3-4766-b5c0-14a819c5c049 service glance] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:59.433732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e14248-c96e-4bf3-a166-c8698d7ee905 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:59.434431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14248-c96e-4bf3-a166-c8698d7ee905 service swift] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:59.434715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14248-c96e-4bf3-a166-c8698d7ee905 service swift] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:59.434989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14248-c96e-4bf3-a166-c8698d7ee905 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:59.444184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e14248-c96e-4bf3-a166-c8698d7ee905 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:59.446470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e14248-c96e-4bf3-a166-c8698d7ee905 service swift] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:59.455504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1202/2402] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:31:59.571656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:59.599469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:59.724642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:59.759300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:00.164042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:00.439472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:00.667271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:00.865604 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:00.985138 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.074619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.101082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.251018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.278687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.392625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.420843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.513112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.615797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.722268 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.906550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:01.941775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:02.137438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:02.169611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:02.312725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:02.347068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:02.455059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:02.487999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:02.662029 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:02.719163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:02.861578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:03.334230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:03.391608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04906ef-b40a-4dad-9b81-7e6c3972ffda None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:03.394392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04906ef-b40a-4dad-9b81-7e6c3972ffda None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:03.394392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04906ef-b40a-4dad-9b81-7e6c3972ffda None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:03.394392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1201/2403] 10.222.0.42 () {54 vars in 961 bytes} [Wed Aug 31 19:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:32:03.398616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e523-4ce9-4d88-8dc7-fc663a4996dd None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:03.398951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e523-4ce9-4d88-8dc7-fc663a4996dd None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:03.399253 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e523-4ce9-4d88-8dc7-fc663a4996dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:03.419978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4691e523-4ce9-4d88-8dc7-fc663a4996dd None None] MFA Rules not processed for user `b98cb3da3efe49acbfe640366bf7b53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:03.421191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4691e523-4ce9-4d88-8dc7-fc663a4996dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:03.483551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1203/2404] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Aug 31 19:32:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:03.493624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04906ef-b40a-4dad-9b81-7e6c3972ffda None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:03.512068 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04906ef-b40a-4dad-9b81-7e6c3972ffda None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:03.519995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca51bcc-892d-4e21-86d7-568be965a728 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:03.520910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51bcc-892d-4e21-86d7-568be965a728 service placement] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:03.521188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51bcc-892d-4e21-86d7-568be965a728 service placement] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:03.521746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51bcc-892d-4e21-86d7-568be965a728 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:03.523560 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8ca51bcc-892d-4e21-86d7-568be965a728 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:03.537867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca51bcc-892d-4e21-86d7-568be965a728 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:03.539503 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca51bcc-892d-4e21-86d7-568be965a728 service placement] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:03.558533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1202/2405] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:03.632623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:03.701216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:03.855869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:03.883912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:03.905015 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:04.045279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:04.079147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:04.299890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:04.476377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:04.558170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:04.922676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:04.958007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:05.095482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:05.129451 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:05.267471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:05.295255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:05.478807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:05.518295 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:05.765534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:06.122855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:06.250008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:06.323977 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:06.472230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:06.499506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:06.684223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:06.747757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.016285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.043634 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.191298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.222014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.439335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.472737 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.579348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.602638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.719460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.752821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:07.958561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:17.987108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=78 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:18.073757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=62 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:18.812335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691e523-4ce9-4d88-8dc7-fc663a4996dd None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:18.878328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691e523-4ce9-4d88-8dc7-fc663a4996dd None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:18.882912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:18.883578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:18.883857 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:18.884131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] PATH_INFO: `/v3/users/c3cdc3d06b474bb6a63362d0e884a404` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:18.885285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3cdc3d06b474bb6a63362d0e884a404)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:18.887239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:19.074257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3cdc3d06b474bb6a63362d0e884a404'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:19.074895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3cdc3d06b474bb6a63362d0e884a404'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:19.075506 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3cdc3d06b474bb6a63362d0e884a404'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:19.157930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3cdc3d06b474bb6a63362d0e884a404'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:19.170945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3cdc3d06b474bb6a63362d0e884a404'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:19.182903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1204/2406] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:18 2022] DELETE /identity/v3/users/c3cdc3d06b474bb6a63362d0e884a404 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:19.187381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ef7f7-4804-492f-947e-3918087c0640 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:19.187876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ef7f7-4804-492f-947e-3918087c0640 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:19.188004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ef7f7-4804-492f-947e-3918087c0640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:19.206808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-0d9ef7f7-4804-492f-947e-3918087c0640 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:19.208016 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0d9ef7f7-4804-492f-947e-3918087c0640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:19.266677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1203/2407] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:19.282533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:19.283944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:19.341296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbc2af-edd0-4418-807f-6c4d2c3f0b21 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:19.345050 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce99cc0-2170-4585-8bb5-a6cf96f8b252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:19.345658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce99cc0-2170-4585-8bb5-a6cf96f8b252 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:19.345960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce99cc0-2170-4585-8bb5-a6cf96f8b252 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:19.346233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce99cc0-2170-4585-8bb5-a6cf96f8b252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:19.356222 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce99cc0-2170-4585-8bb5-a6cf96f8b252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:19.357650 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce99cc0-2170-4585-8bb5-a6cf96f8b252 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:19.367108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1205/2408] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:32:19.810963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ef7f7-4804-492f-947e-3918087c0640 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:19.812497 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0d9ef7f7-4804-492f-947e-3918087c0640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:19.827359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ef7f7-4804-492f-947e-3918087c0640 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:19.832581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:19.833221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:19.833502 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:19.834335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] PATH_INFO: `/v3/projects/d0fae81b04f742b99b6b3a6f6bf7cfea` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:19.843411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0fae81b04f742b99b6b3a6f6bf7cfea)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:19.845363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:20.004824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0fae81b04f742b99b6b3a6f6bf7cfea', 'request_id': 'req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:20.011879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0fae81b04f742b99b6b3a6f6bf7cfea', 'request_id': 'req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:20.106804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0fae81b04f742b99b6b3a6f6bf7cfea', 'request_id': 'req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:20.121931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] The token cache is being invalidate because project d0fae81b04f742b99b6b3a6f6bf7cfea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:20.122690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:20.123557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-dd2c3876-e8e2-48b7-8967-2d97f1f82d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:20.125333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1204/2409] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:19 2022] DELETE /identity/v3/projects/d0fae81b04f742b99b6b3a6f6bf7cfea => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:20.130668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9d2a5-2114-40c9-a769-4e7719cf85b5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.131155 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9d2a5-2114-40c9-a769-4e7719cf85b5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.131243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9d2a5-2114-40c9-a769-4e7719cf85b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.152017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5df9d2a5-2114-40c9-a769-4e7719cf85b5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:20.153224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5df9d2a5-2114-40c9-a769-4e7719cf85b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:20.171786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:20.218086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1206/2410] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:20.222116 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8bd8f-58f3-411f-be26-f19a4058e1b0 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.222588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8bd8f-58f3-411f-be26-f19a4058e1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.222681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8bd8f-58f3-411f-be26-f19a4058e1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.243506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-55c8bd8f-58f3-411f-be26-f19a4058e1b0 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:20.244715 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-55c8bd8f-58f3-411f-be26-f19a4058e1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:20.252733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1205/2411] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:20.257261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9d2a5-2114-40c9-a769-4e7719cf85b5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:20.267349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9d2a5-2114-40c9-a769-4e7719cf85b5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:20.272644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16bbb5-6584-4470-95bd-d25301611e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:20.273276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16bbb5-6584-4470-95bd-d25301611e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.273560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16bbb5-6584-4470-95bd-d25301611e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.273871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16bbb5-6584-4470-95bd-d25301611e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.274525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16bbb5-6584-4470-95bd-d25301611e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:32:20.274832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16bbb5-6584-4470-95bd-d25301611e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:20.276477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16bbb5-6584-4470-95bd-d25301611e60 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:20.288635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1207/2412] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:32:20.294834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8bd8f-58f3-411f-be26-f19a4058e1b0 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:20.304983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8bd8f-58f3-411f-be26-f19a4058e1b0 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:20.310453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4fdc2-d05d-4d63-90db-6bf24402fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:20.311066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4fdc2-d05d-4d63-90db-6bf24402fb5c admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.311350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4fdc2-d05d-4d63-90db-6bf24402fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.311751 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4fdc2-d05d-4d63-90db-6bf24402fb5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.312411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4fdc2-d05d-4d63-90db-6bf24402fb5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:20.314345 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4fdc2-d05d-4d63-90db-6bf24402fb5c admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:20.441532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1206/2413] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:32:20 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:20.445819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16bbb5-6584-4470-95bd-d25301611e60 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:20.461296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16bbb5-6584-4470-95bd-d25301611e60 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:20.529151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965c6d-c061-4deb-9a8c-71cd5b0f94d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:20.529708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965c6d-c061-4deb-9a8c-71cd5b0f94d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.529991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965c6d-c061-4deb-9a8c-71cd5b0f94d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.530265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90965c6d-c061-4deb-9a8c-71cd5b0f94d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.530907 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90965c6d-c061-4deb-9a8c-71cd5b0f94d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:20.532805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90965c6d-c061-4deb-9a8c-71cd5b0f94d6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:20.695240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1208/2414] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:32:20 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:32:20.699370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4fdc2-d05d-4d63-90db-6bf24402fb5c admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:20.709764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4fdc2-d05d-4d63-90db-6bf24402fb5c admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:20.714978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918b5c6-a9b5-42cd-a346-25a2529a3700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:20.715626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b5c6-a9b5-42cd-a346-25a2529a3700 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.715914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b5c6-a9b5-42cd-a346-25a2529a3700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.716195 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b5c6-a9b5-42cd-a346-25a2529a3700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.716849 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918b5c6-a9b5-42cd-a346-25a2529a3700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:20.718735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918b5c6-a9b5-42cd-a346-25a2529a3700 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:20.729468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1207/2415] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:20.733611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965c6d-c061-4deb-9a8c-71cd5b0f94d6 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:20.743602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90965c6d-c061-4deb-9a8c-71cd5b0f94d6 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:20.749104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783e9c8-5b42-418c-847b-0cf0dd55e653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:20.749104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e9c8-5b42-418c-847b-0cf0dd55e653 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.749104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e9c8-5b42-418c-847b-0cf0dd55e653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.749613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e9c8-5b42-418c-847b-0cf0dd55e653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.750201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783e9c8-5b42-418c-847b-0cf0dd55e653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:20.751705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783e9c8-5b42-418c-847b-0cf0dd55e653 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:20.763027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1209/2416] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:32:20.767350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918b5c6-a9b5-42cd-a346-25a2529a3700 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:20.778262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918b5c6-a9b5-42cd-a346-25a2529a3700 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:20.782919 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627a7cf-1447-4fa5-a735-87a1e7355ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:20.783512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627a7cf-1447-4fa5-a735-87a1e7355ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.783798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627a7cf-1447-4fa5-a735-87a1e7355ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.784078 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627a7cf-1447-4fa5-a735-87a1e7355ba4 admin admin] PATH_INFO: `/v3/projects/6d3ad5afa50145fe93475ad683e0bb0d/users/b88e28bf80ce4fb581ee0ed1e2c5ab97/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.799324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627a7cf-1447-4fa5-a735-87a1e7355ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3ad5afa50145fe93475ad683e0bb0d, user_id=b88e28bf80ce4fb581ee0ed1e2c5ab97, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:20.802086 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627a7cf-1447-4fa5-a735-87a1e7355ba4 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:20.889924 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1208/2417] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:32:20 2022] PUT /identity/v3/projects/6d3ad5afa50145fe93475ad683e0bb0d/users/b88e28bf80ce4fb581ee0ed1e2c5ab97/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:20.900637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f4f81-cab7-43d1-acea-110fc7e81c60 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:20.900921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f4f81-cab7-43d1-acea-110fc7e81c60 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:20.901198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f4f81-cab7-43d1-acea-110fc7e81c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:20.929757 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-302f4f81-cab7-43d1-acea-110fc7e81c60 None None] MFA Rules not processed for user `b88e28bf80ce4fb581ee0ed1e2c5ab97`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:20.930981 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-302f4f81-cab7-43d1-acea-110fc7e81c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:21.004881 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1210/2418] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:32:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:21.016987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627a7cf-1447-4fa5-a735-87a1e7355ba4 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:21.018711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6627a7cf-1447-4fa5-a735-87a1e7355ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:21.041238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:21.077975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627a7cf-1447-4fa5-a735-87a1e7355ba4 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:21.082256 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ac64-a460-4236-8f48-38d043045a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:21.082875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ac64-a460-4236-8f48-38d043045a76 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:21.087215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ac64-a460-4236-8f48-38d043045a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:21.087215 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ac64-a460-4236-8f48-38d043045a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:21.092726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ac64-a460-4236-8f48-38d043045a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:21.094235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ac64-a460-4236-8f48-38d043045a76 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:21.103045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1209/2419] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:23.579152 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446740ee-7a76-4fbb-b7c2-d42527de8462 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:23.579657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446740ee-7a76-4fbb-b7c2-d42527de8462 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:23.579657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446740ee-7a76-4fbb-b7c2-d42527de8462 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:23.581049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1211/2420] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:32:23.587370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d37b4-08f2-4412-95f9-eb2e06919e55 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:23.587866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d37b4-08f2-4412-95f9-eb2e06919e55 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:23.588104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d37b4-08f2-4412-95f9-eb2e06919e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:23.609082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-284d37b4-08f2-4412-95f9-eb2e06919e55 None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:23.610335 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-284d37b4-08f2-4412-95f9-eb2e06919e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:23.679507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1210/2421] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:32:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:23.691139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446740ee-7a76-4fbb-b7c2-d42527de8462 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:23.692948 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-446740ee-7a76-4fbb-b7c2-d42527de8462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:23.714235 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:23.754998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446740ee-7a76-4fbb-b7c2-d42527de8462 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:23.758627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6753b77-9b63-4ca1-8451-8bbdb4ef9d47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f14e5614aee44c59a47b12e5b35ea3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:23.759239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6753b77-9b63-4ca1-8451-8bbdb4ef9d47 service glance] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:23.759522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6753b77-9b63-4ca1-8451-8bbdb4ef9d47 service glance] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:23.759800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6753b77-9b63-4ca1-8451-8bbdb4ef9d47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:23.770642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6753b77-9b63-4ca1-8451-8bbdb4ef9d47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:23.772090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6753b77-9b63-4ca1-8451-8bbdb4ef9d47 service glance] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:23.784048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1212/2422] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:24.125837 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3113dc7-bfb0-4da2-891c-7d4ac4fa02a4 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.131726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3113dc7-bfb0-4da2-891c-7d4ac4fa02a4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.131726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3113dc7-bfb0-4da2-891c-7d4ac4fa02a4 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.131726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1211/2423] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:32:24.134317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15a309-1d75-43d1-b882-b63f8260f1d5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.134619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15a309-1d75-43d1-b882-b63f8260f1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.134900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15a309-1d75-43d1-b882-b63f8260f1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.155620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4a15a309-1d75-43d1-b882-b63f8260f1d5 None None] MFA Rules not processed for user `b263d1092fc148129020ba73f2b8fbd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:24.156861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4a15a309-1d75-43d1-b882-b63f8260f1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:24.210264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1213/2424] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:32:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:24.223250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3113dc7-bfb0-4da2-891c-7d4ac4fa02a4 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:24.225039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a3113dc7-bfb0-4da2-891c-7d4ac4fa02a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:24.239766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3113dc7-bfb0-4da2-891c-7d4ac4fa02a4 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:24.244173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18f360-2833-4d95-9638-50a023568003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:24.244655 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18f360-2833-4d95-9638-50a023568003 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.244943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18f360-2833-4d95-9638-50a023568003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.245227 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18f360-2833-4d95-9638-50a023568003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.252969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18f360-2833-4d95-9638-50a023568003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:24.254528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18f360-2833-4d95-9638-50a023568003 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:24.265392 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1212/2425] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:24.353009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c249-9ecc-4deb-ba23-fd28beb315d3 None None] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.353325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c249-9ecc-4deb-ba23-fd28beb315d3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.353606 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c249-9ecc-4deb-ba23-fd28beb315d3 None None] PATH_INFO: `/` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.355031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1214/2426] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:32:24.360271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad06b2d-beaf-4caa-8fc9-a81e19d84b5c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.360852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad06b2d-beaf-4caa-8fc9-a81e19d84b5c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.360852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad06b2d-beaf-4caa-8fc9-a81e19d84b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.382698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4ad06b2d-beaf-4caa-8fc9-a81e19d84b5c None None] MFA Rules not processed for user `799cbde43a3643a4beef892d23145112`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:24.384476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4ad06b2d-beaf-4caa-8fc9-a81e19d84b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:24.393758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1213/2427] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:32:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:24.404605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c249-9ecc-4deb-ba23-fd28beb315d3 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:24.415957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c249-9ecc-4deb-ba23-fd28beb315d3 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:24.419759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a6306-e8fa-4136-8d59-fb0ee542d7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:24.420507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a6306-e8fa-4136-8d59-fb0ee542d7cb service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:24.420793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a6306-e8fa-4136-8d59-fb0ee542d7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:24.421066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a6306-e8fa-4136-8d59-fb0ee542d7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:24.432262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a6306-e8fa-4136-8d59-fb0ee542d7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:24.433714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a6306-e8fa-4136-8d59-fb0ee542d7cb service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:24.446818 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1215/2428] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:29.729821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1ea0-702d-4575-98a4-7161d9d91148 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:29.732405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1ea0-702d-4575-98a4-7161d9d91148 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:29.732405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1ea0-702d-4575-98a4-7161d9d91148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:29.750725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-beae1ea0-702d-4575-98a4-7161d9d91148 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:29.752028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-beae1ea0-702d-4575-98a4-7161d9d91148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:29.808225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1214/2429] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:32:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:29.822353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a6306-e8fa-4136-8d59-fb0ee542d7cb service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:29.824382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4f8a6306-e8fa-4136-8d59-fb0ee542d7cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:29.893967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a6306-e8fa-4136-8d59-fb0ee542d7cb service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:29.898944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7f128-9a17-4935-9006-10df10dbda24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:29.899614 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f128-9a17-4935-9006-10df10dbda24 service swift] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:29.899896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f128-9a17-4935-9006-10df10dbda24 service swift] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:29.900170 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f128-9a17-4935-9006-10df10dbda24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:29.908724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7f128-9a17-4935-9006-10df10dbda24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:29.916069 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7f128-9a17-4935-9006-10df10dbda24 service swift] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:29.918503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1216/2430] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:32:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:32:31.375673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae1ea0-702d-4575-98a4-7161d9d91148 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:31.421521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:31.443822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae1ea0-702d-4575-98a4-7161d9d91148 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:31.448794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:31.449605 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:31.450005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:31.450306 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] PATH_INFO: `/v3/users/b88e28bf80ce4fb581ee0ed1e2c5ab97` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:31.451453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88e28bf80ce4fb581ee0ed1e2c5ab97)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:31.453358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:31.676636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88e28bf80ce4fb581ee0ed1e2c5ab97'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:31.776760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88e28bf80ce4fb581ee0ed1e2c5ab97'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:31.777489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88e28bf80ce4fb581ee0ed1e2c5ab97'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:31.802653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88e28bf80ce4fb581ee0ed1e2c5ab97'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:31.803420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88e28bf80ce4fb581ee0ed1e2c5ab97'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:31.836999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1215/2431] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:32:31 2022] DELETE /identity/v3/users/b88e28bf80ce4fb581ee0ed1e2c5ab97 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:31.841049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6c47-f906-4f35-a6ba-7f32357e5f37 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:31.841555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6c47-f906-4f35-a6ba-7f32357e5f37 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:31.841649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6c47-f906-4f35-a6ba-7f32357e5f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:31.863265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-cf2d6c47-f906-4f35-a6ba-7f32357e5f37 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:31.864482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cf2d6c47-f906-4f35-a6ba-7f32357e5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:31.907975 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:31.926405 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1217/2432] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:31.940458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:31.940458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:31.998981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20b31c-621c-4bad-a825-2c9208a90b27 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:32.002514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3100548-5bca-4853-9798-b6292671476d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:32.003130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3100548-5bca-4853-9798-b6292671476d service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:32.003409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3100548-5bca-4853-9798-b6292671476d service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:32.003683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3100548-5bca-4853-9798-b6292671476d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:32.013415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3100548-5bca-4853-9798-b6292671476d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:32.014877 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3100548-5bca-4853-9798-b6292671476d service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:32.024734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1216/2433] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:32:32.514483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d6c47-f906-4f35-a6ba-7f32357e5f37 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:32.516132 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cf2d6c47-f906-4f35-a6ba-7f32357e5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:32.530221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d6c47-f906-4f35-a6ba-7f32357e5f37 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:32.535491 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:32.536324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:32.536596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:32.536869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] PATH_INFO: `/v3/projects/6d3ad5afa50145fe93475ad683e0bb0d` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:32.538237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3ad5afa50145fe93475ad683e0bb0d)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:32.540278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:32.698816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3ad5afa50145fe93475ad683e0bb0d', 'request_id': 'req-55dc701b-e574-4699-a6ad-4671fafb4de1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:32.707759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3ad5afa50145fe93475ad683e0bb0d', 'request_id': 'req-55dc701b-e574-4699-a6ad-4671fafb4de1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:32.861419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3ad5afa50145fe93475ad683e0bb0d', 'request_id': 'req-55dc701b-e574-4699-a6ad-4671fafb4de1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:32.875493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] The token cache is being invalidate because project 6d3ad5afa50145fe93475ad683e0bb0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:32:32.875827 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:32.876575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:32:32.878120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1218/2434] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:32:32 2022] DELETE /identity/v3/projects/6d3ad5afa50145fe93475ad683e0bb0d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:32:42.020378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:42.871107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:51.533766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369693-c58b-41d8-adde-5b3c3f1b7c78 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:51.534305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369693-c58b-41d8-adde-5b3c3f1b7c78 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:51.534305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369693-c58b-41d8-adde-5b3c3f1b7c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:51.554174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-75369693-c58b-41d8-adde-5b3c3f1b7c78 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:32:51.555496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-75369693-c58b-41d8-adde-5b3c3f1b7c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:51.612295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1217/2435] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 31 19:32:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:32:51.625437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:32:51.626910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:32:51.695365 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc701b-e574-4699-a6ad-4671fafb4de1 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:32:51.700338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa07cc2-499a-435d-be8a-801ad2a26f59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:32:51.700944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa07cc2-499a-435d-be8a-801ad2a26f59 service swift] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:32:51.701226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa07cc2-499a-435d-be8a-801ad2a26f59 service swift] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:32:51.701501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa07cc2-499a-435d-be8a-801ad2a26f59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:32:51.709716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa07cc2-499a-435d-be8a-801ad2a26f59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:32:51.712068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa07cc2-499a-435d-be8a-801ad2a26f59 service swift] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:32:51.720098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1219/2436] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:32:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:33:01.604844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=25 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:01.716610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=32 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:20.785992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369693-c58b-41d8-adde-5b3c3f1b7c78 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:20.787483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-75369693-c58b-41d8-adde-5b3c3f1b7c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:20.846308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369693-c58b-41d8-adde-5b3c3f1b7c78 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:20.851389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04953a-0199-4086-98f1-8bda41f78a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:20.851389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04953a-0199-4086-98f1-8bda41f78a15 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:20.851620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04953a-0199-4086-98f1-8bda41f78a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:20.851716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04953a-0199-4086-98f1-8bda41f78a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:20.853485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ab04953a-0199-4086-98f1-8bda41f78a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:20.927650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04953a-0199-4086-98f1-8bda41f78a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:20.929091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04953a-0199-4086-98f1-8bda41f78a15 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:20.941073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1218/2437] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:22.126269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa07cc2-499a-435d-be8a-801ad2a26f59 service swift] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:22.136130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa07cc2-499a-435d-be8a-801ad2a26f59 service swift] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:22.140355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0709bf-635d-41b6-84b9-71dd72ee5d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:22.140967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0709bf-635d-41b6-84b9-71dd72ee5d3f service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:22.141249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0709bf-635d-41b6-84b9-71dd72ee5d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:22.141622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0709bf-635d-41b6-84b9-71dd72ee5d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:22.143486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6d0709bf-635d-41b6-84b9-71dd72ee5d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:22.158630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0709bf-635d-41b6-84b9-71dd72ee5d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:22.162309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0709bf-635d-41b6-84b9-71dd72ee5d3f service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:22.171854 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1220/2438] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:30.935881 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=54 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:32.166543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=6 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:34.075229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04953a-0199-4086-98f1-8bda41f78a15 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:34.076706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ab04953a-0199-4086-98f1-8bda41f78a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:34.090734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04953a-0199-4086-98f1-8bda41f78a15 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:34.096825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e38e9-24fa-41c2-b8b0-b89f7940b95e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:34.097296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e38e9-24fa-41c2-b8b0-b89f7940b95e service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:34.097598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e38e9-24fa-41c2-b8b0-b89f7940b95e service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:34.097934 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e38e9-24fa-41c2-b8b0-b89f7940b95e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:34.099755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1a7e38e9-24fa-41c2-b8b0-b89f7940b95e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:34.161271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e38e9-24fa-41c2-b8b0-b89f7940b95e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:34.163227 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e38e9-24fa-41c2-b8b0-b89f7940b95e service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:34.174621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1219/2439] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:34.381801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636ac5d-1789-45e7-9093-5247ac0bf8de None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:34.382380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636ac5d-1789-45e7-9093-5247ac0bf8de None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:34.382380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636ac5d-1789-45e7-9093-5247ac0bf8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:34.402216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-b636ac5d-1789-45e7-9093-5247ac0bf8de None None] MFA Rules not processed for user `6773bc20a0d740e588f1858e5e9b1d11`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:33:34.403314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b636ac5d-1789-45e7-9093-5247ac0bf8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:34.410590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1221/2440] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:33:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:33:40.509087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e38e9-24fa-41c2-b8b0-b89f7940b95e service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:40.522372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e38e9-24fa-41c2-b8b0-b89f7940b95e service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:40.528875 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f97f1-d5bc-412f-855e-1f7d2d953b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:40.529558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f97f1-d5bc-412f-855e-1f7d2d953b2d service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:40.529976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f97f1-d5bc-412f-855e-1f7d2d953b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:40.530332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f97f1-d5bc-412f-855e-1f7d2d953b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:40.532187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-158f97f1-d5bc-412f-855e-1f7d2d953b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:40.604457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f97f1-d5bc-412f-855e-1f7d2d953b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:40.606889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f97f1-d5bc-412f-855e-1f7d2d953b2d service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:40.620306 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1220/2441] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:33:44.396951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:50.615499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=56 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:51.248173 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636ac5d-1789-45e7-9093-5247ac0bf8de None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:33:51.249797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b636ac5d-1789-45e7-9093-5247ac0bf8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:51.263271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636ac5d-1789-45e7-9093-5247ac0bf8de None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:33:51.267961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa8c2a-3c5b-4fff-a58c-0078d024b65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:33:51.267961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa8c2a-3c5b-4fff-a58c-0078d024b65c service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:33:51.268591 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa8c2a-3c5b-4fff-a58c-0078d024b65c service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:33:51.269071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa8c2a-3c5b-4fff-a58c-0078d024b65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:33:51.271226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-21aa8c2a-3c5b-4fff-a58c-0078d024b65c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:33:51.282672 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa8c2a-3c5b-4fff-a58c-0078d024b65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:33:51.284190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa8c2a-3c5b-4fff-a58c-0078d024b65c service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:33:51.297072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1222/2442] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:33:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:01.289195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=6 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:01.520900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f97f1-d5bc-412f-855e-1f7d2d953b2d service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:01.522469 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-158f97f1-d5bc-412f-855e-1f7d2d953b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:01.538691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f97f1-d5bc-412f-855e-1f7d2d953b2d service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:01.544415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d684e8-6e66-4ba2-a815-6205db8f1b2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:01.544964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d684e8-6e66-4ba2-a815-6205db8f1b2e service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:01.545247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d684e8-6e66-4ba2-a815-6205db8f1b2e service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:01.545525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d684e8-6e66-4ba2-a815-6205db8f1b2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:01.547337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c4d684e8-6e66-4ba2-a815-6205db8f1b2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:01.607911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d684e8-6e66-4ba2-a815-6205db8f1b2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:01.609545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d684e8-6e66-4ba2-a815-6205db8f1b2e service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:01.627948 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1221/2443] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:09.044495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa8c2a-3c5b-4fff-a58c-0078d024b65c service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:09.061914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa8c2a-3c5b-4fff-a58c-0078d024b65c service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:09.069035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d53e-4aa6-4c46-9c7b-01a43d34c6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:09.069659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d53e-4aa6-4c46-9c7b-01a43d34c6e9 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:09.069964 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d53e-4aa6-4c46-9c7b-01a43d34c6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:09.070236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d53e-4aa6-4c46-9c7b-01a43d34c6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:09.072536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7fd1d53e-4aa6-4c46-9c7b-01a43d34c6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:09.089507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1d53e-4aa6-4c46-9c7b-01a43d34c6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:09.091494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1d53e-4aa6-4c46-9c7b-01a43d34c6e9 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:09.104003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1223/2444] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:11.615855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=28 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:15.567900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1f622-f696-4172-a62f-d47fa24f6c2b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:15.568554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1f622-f696-4172-a62f-d47fa24f6c2b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:15.568554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1f622-f696-4172-a62f-d47fa24f6c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:15.588400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ebd1f622-f696-4172-a62f-d47fa24f6c2b None None] MFA Rules not processed for user `9b0a09141e3748359837fed83f0eff98`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:34:15.589618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ebd1f622-f696-4172-a62f-d47fa24f6c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:15.597628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1222/2445] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:34:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:34:15.907728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d53e-4aa6-4c46-9c7b-01a43d34c6e9 service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:15.917118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d53e-4aa6-4c46-9c7b-01a43d34c6e9 service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:15.920670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba73c5d-93f3-475a-b0b6-3602b163918b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:15.921274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73c5d-93f3-475a-b0b6-3602b163918b service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:15.921547 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73c5d-93f3-475a-b0b6-3602b163918b service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:15.921858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73c5d-93f3-475a-b0b6-3602b163918b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:15.923671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cba73c5d-93f3-475a-b0b6-3602b163918b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:15.934878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba73c5d-93f3-475a-b0b6-3602b163918b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:15.938070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba73c5d-93f3-475a-b0b6-3602b163918b service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:15.947331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1224/2446] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:16.344259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1f622-f696-4172-a62f-d47fa24f6c2b None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:16.345695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ebd1f622-f696-4172-a62f-d47fa24f6c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:16.417429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1f622-f696-4172-a62f-d47fa24f6c2b None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:16.423172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c463f7e-1331-4248-8b01-e4f621457697 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:16.423782 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463f7e-1331-4248-8b01-e4f621457697 service placement] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:16.424066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463f7e-1331-4248-8b01-e4f621457697 service placement] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:16.424343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463f7e-1331-4248-8b01-e4f621457697 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:16.426118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0c463f7e-1331-4248-8b01-e4f621457697 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:16.437372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c463f7e-1331-4248-8b01-e4f621457697 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:16.438983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c463f7e-1331-4248-8b01-e4f621457697 service placement] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:16.448808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1223/2447] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:25.943482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=12 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:26.444545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=35 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:29.383166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba73c5d-93f3-475a-b0b6-3602b163918b service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:29.397207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba73c5d-93f3-475a-b0b6-3602b163918b service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:29.402805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02fbf-5837-4d65-a742-ed3c488254e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:29.403405 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02fbf-5837-4d65-a742-ed3c488254e8 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:29.403755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02fbf-5837-4d65-a742-ed3c488254e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:29.404035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02fbf-5837-4d65-a742-ed3c488254e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:29.406322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d6e02fbf-5837-4d65-a742-ed3c488254e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:29.418480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02fbf-5837-4d65-a742-ed3c488254e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:29.420122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02fbf-5837-4d65-a742-ed3c488254e8 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:29.431441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1225/2448] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:34.047089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c463f7e-1331-4248-8b01-e4f621457697 service placement] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:34:34.059304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c463f7e-1331-4248-8b01-e4f621457697 service placement] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:34:34.065359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddbc0d-a932-456f-a50c-0d3ea4fbc414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:34:34.066030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddbc0d-a932-456f-a50c-0d3ea4fbc414 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:34:34.066290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddbc0d-a932-456f-a50c-0d3ea4fbc414 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:34:34.066563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddbc0d-a932-456f-a50c-0d3ea4fbc414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:34:34.068298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-72ddbc0d-a932-456f-a50c-0d3ea4fbc414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:34:34.081037 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddbc0d-a932-456f-a50c-0d3ea4fbc414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:34:34.082614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddbc0d-a932-456f-a50c-0d3ea4fbc414 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:34:34.093354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1224/2449] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:34:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:34:39.427022 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=6 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:44.088744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=6 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:14.611873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02fbf-5837-4d65-a742-ed3c488254e8 service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:14.637415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02fbf-5837-4d65-a742-ed3c488254e8 service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:14.642620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3bc18-cbcf-4530-8a06-8d87efa909dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:14.643696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3bc18-cbcf-4530-8a06-8d87efa909dc service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:14.644420 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3bc18-cbcf-4530-8a06-8d87efa909dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:14.644928 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3bc18-cbcf-4530-8a06-8d87efa909dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:14.647349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-44b3bc18-cbcf-4530-8a06-8d87efa909dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:14.746337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3bc18-cbcf-4530-8a06-8d87efa909dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:14.748022 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3bc18-cbcf-4530-8a06-8d87efa909dc service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:14.760519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1226/2450] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:19.236410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddbc0d-a932-456f-a50c-0d3ea4fbc414 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:19.246053 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-72ddbc0d-a932-456f-a50c-0d3ea4fbc414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:19.252970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddbc0d-a932-456f-a50c-0d3ea4fbc414 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:19.258667 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad6172-0526-4a0d-9c6d-7f726b10c701 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:19.259513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad6172-0526-4a0d-9c6d-7f726b10c701 service placement] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:19.259792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad6172-0526-4a0d-9c6d-7f726b10c701 service placement] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:19.260260 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad6172-0526-4a0d-9c6d-7f726b10c701 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:19.262709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-06ad6172-0526-4a0d-9c6d-7f726b10c701 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:19.275817 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad6172-0526-4a0d-9c6d-7f726b10c701 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:19.277455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad6172-0526-4a0d-9c6d-7f726b10c701 service placement] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:19.288687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1225/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:19.487578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3bc18-cbcf-4530-8a06-8d87efa909dc service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:19.487578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-44b3bc18-cbcf-4530-8a06-8d87efa909dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:19.498070 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3bc18-cbcf-4530-8a06-8d87efa909dc service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:19.503462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:19.504090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:19.504366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:19.505123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] PATH_INFO: `/v3/users/6773bc20a0d740e588f1858e5e9b1d11` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:19.505791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6773bc20a0d740e588f1858e5e9b1d11)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:19.507718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:20.056746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6773bc20a0d740e588f1858e5e9b1d11'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:20.057308 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6773bc20a0d740e588f1858e5e9b1d11'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:20.058003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6773bc20a0d740e588f1858e5e9b1d11'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:20.261759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6773bc20a0d740e588f1858e5e9b1d11'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:20.289047 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-07578b50-913e-43a2-b0f5-cbe8b1f2f0ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6773bc20a0d740e588f1858e5e9b1d11'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:20.313215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1227/2452] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:19 2022] DELETE /identity/v3/users/6773bc20a0d740e588f1858e5e9b1d11 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:20.716110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad6172-0526-4a0d-9c6d-7f726b10c701 service placement] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:20.722284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad6172-0526-4a0d-9c6d-7f726b10c701 service placement] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:20.787964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:20.788744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:20.789130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:20.789505 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] PATH_INFO: `/v3/projects/0324975199494d4a8278e4b9438e78ef` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:20.791011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0324975199494d4a8278e4b9438e78ef)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:20.793027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:21.076629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0324975199494d4a8278e4b9438e78ef', 'request_id': 'req-2670f44e-db3b-4b45-bde3-a405711b3e8c'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:21.082243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0324975199494d4a8278e4b9438e78ef', 'request_id': 'req-2670f44e-db3b-4b45-bde3-a405711b3e8c'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:21.218011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0324975199494d4a8278e4b9438e78ef', 'request_id': 'req-2670f44e-db3b-4b45-bde3-a405711b3e8c'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:21.232423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] The token cache is being invalidate because project 0324975199494d4a8278e4b9438e78ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:21.232713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:21.233633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-2670f44e-db3b-4b45-bde3-a405711b3e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:21.239119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1226/2453] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:20 2022] DELETE /identity/v3/projects/0324975199494d4a8278e4b9438e78ef => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:21.240790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fe4c0-5542-4397-a47d-cee535e636aa None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:21.241255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fe4c0-5542-4397-a47d-cee535e636aa None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:21.241346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fe4c0-5542-4397-a47d-cee535e636aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:21.263251 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-338fe4c0-5542-4397-a47d-cee535e636aa None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:21.264926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-338fe4c0-5542-4397-a47d-cee535e636aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:21.334945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1228/2454] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:21.342748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ef50d-a032-4aac-8149-12ee6364b187 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:21.343039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ef50d-a032-4aac-8149-12ee6364b187 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:21.346238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ef50d-a032-4aac-8149-12ee6364b187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:21.365108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-925ef50d-a032-4aac-8149-12ee6364b187 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:21.366209 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-925ef50d-a032-4aac-8149-12ee6364b187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:21.374410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1227/2455] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:35:21.378748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fe4c0-5542-4397-a47d-cee535e636aa None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:21.391076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fe4c0-5542-4397-a47d-cee535e636aa None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:21.405830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf56ae-3f0e-4f56-baee-bb06888dfa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:21.405830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf56ae-3f0e-4f56-baee-bb06888dfa13 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:21.405830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf56ae-3f0e-4f56-baee-bb06888dfa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:21.405830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf56ae-3f0e-4f56-baee-bb06888dfa13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:21.406707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf56ae-3f0e-4f56-baee-bb06888dfa13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:35:21.406707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf56ae-3f0e-4f56-baee-bb06888dfa13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:21.406707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf56ae-3f0e-4f56-baee-bb06888dfa13 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:21.406707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:21.414878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1229/2456] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:35:21.419444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ef50d-a032-4aac-8149-12ee6364b187 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:21.429750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ef50d-a032-4aac-8149-12ee6364b187 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:21.437455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6272a00-bab2-47a7-93a0-8f11a61fd7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:21.438126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6272a00-bab2-47a7-93a0-8f11a61fd7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:21.438391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6272a00-bab2-47a7-93a0-8f11a61fd7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:21.438663 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6272a00-bab2-47a7-93a0-8f11a61fd7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:21.439328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6272a00-bab2-47a7-93a0-8f11a61fd7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:21.441370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6272a00-bab2-47a7-93a0-8f11a61fd7d5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:21.495875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13cb5f-6997-4118-9ac7-0812ab26fd79 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:21.496163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13cb5f-6997-4118-9ac7-0812ab26fd79 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:21.496571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13cb5f-6997-4118-9ac7-0812ab26fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:21.517259 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9e13cb5f-6997-4118-9ac7-0812ab26fd79 None None] MFA Rules not processed for user `27d710f7757e427fbf3921ab488b0ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:21.518519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9e13cb5f-6997-4118-9ac7-0812ab26fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:21.576105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1230/2457] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:35:21.731675 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1228/2458] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:35:21 2022] POST /identity/v3/projects => generated 373 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:21.736060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13cb5f-6997-4118-9ac7-0812ab26fd79 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:21.746468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13cb5f-6997-4118-9ac7-0812ab26fd79 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:21.811140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed82e2-c014-4c73-abef-b854f1c04efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:21.811765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed82e2-c014-4c73-abef-b854f1c04efd admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:21.812048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed82e2-c014-4c73-abef-b854f1c04efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:21.812322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed82e2-c014-4c73-abef-b854f1c04efd admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:21.812976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed82e2-c014-4c73-abef-b854f1c04efd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:21.816276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed82e2-c014-4c73-abef-b854f1c04efd admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:21.904061 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6272a00-bab2-47a7-93a0-8f11a61fd7d5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:21.905786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c6272a00-bab2-47a7-93a0-8f11a61fd7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:21.942900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1231/2459] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:35:21 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:21.947005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed82e2-c014-4c73-abef-b854f1c04efd admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:21.958051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed82e2-c014-4c73-abef-b854f1c04efd admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:21.963527 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:21.964708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271347a-649b-4eb2-841a-33a554089569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:21.965562 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271347a-649b-4eb2-841a-33a554089569 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:21.965910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271347a-649b-4eb2-841a-33a554089569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:21.966356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271347a-649b-4eb2-841a-33a554089569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:21.967148 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271347a-649b-4eb2-841a-33a554089569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:21.969543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6272a00-bab2-47a7-93a0-8f11a61fd7d5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:21.970773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271347a-649b-4eb2-841a-33a554089569 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:21.975569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de48ad4-451b-4187-b71b-6ef2d744e32b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:21.976553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de48ad4-451b-4187-b71b-6ef2d744e32b service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:21.977229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de48ad4-451b-4187-b71b-6ef2d744e32b service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:21.977724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de48ad4-451b-4187-b71b-6ef2d744e32b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:21.980588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0de48ad4-451b-4187-b71b-6ef2d744e32b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:21.990566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1232/2460] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:21.994465 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de48ad4-451b-4187-b71b-6ef2d744e32b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:21.996000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de48ad4-451b-4187-b71b-6ef2d744e32b service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:21.997062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271347a-649b-4eb2-841a-33a554089569 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:22.006260 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1229/2461] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:35:22.007981 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271347a-649b-4eb2-841a-33a554089569 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:22.012767 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76506a1c-99c4-4be5-9fc6-09fc6139a696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:22.013386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506a1c-99c4-4be5-9fc6-09fc6139a696 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:22.013682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506a1c-99c4-4be5-9fc6-09fc6139a696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:22.013979 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506a1c-99c4-4be5-9fc6-09fc6139a696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:22.014643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506a1c-99c4-4be5-9fc6-09fc6139a696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:22.016848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506a1c-99c4-4be5-9fc6-09fc6139a696 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:22.028073 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1233/2462] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:22.032868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de48ad4-451b-4187-b71b-6ef2d744e32b service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:22.045595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de48ad4-451b-4187-b71b-6ef2d744e32b service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:22.050492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5872ec-69ce-486a-ab9b-54b0f239d601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:22.051163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5872ec-69ce-486a-ab9b-54b0f239d601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:22.051445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5872ec-69ce-486a-ab9b-54b0f239d601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:22.051726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5872ec-69ce-486a-ab9b-54b0f239d601 admin admin] PATH_INFO: `/v3/projects/4f95ba52a72c4db390c812f58758afa1/users/37198a56351547da9f86b7680ea6f304/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:22.067714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5872ec-69ce-486a-ab9b-54b0f239d601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f95ba52a72c4db390c812f58758afa1, user_id=37198a56351547da9f86b7680ea6f304, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:22.070442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5872ec-69ce-486a-ab9b-54b0f239d601 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:22.195949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1230/2463] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:22 2022] PUT /identity/v3/projects/4f95ba52a72c4db390c812f58758afa1/users/37198a56351547da9f86b7680ea6f304/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:22.210095 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52103-4f19-4a14-8015-2f264d6af195 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:22.210433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52103-4f19-4a14-8015-2f264d6af195 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:22.210767 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52103-4f19-4a14-8015-2f264d6af195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:22.243596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-10a52103-4f19-4a14-8015-2f264d6af195 None None] MFA Rules not processed for user `37198a56351547da9f86b7680ea6f304`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:22.244522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-10a52103-4f19-4a14-8015-2f264d6af195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:22.313287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1234/2464] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:22.318060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5872ec-69ce-486a-ab9b-54b0f239d601 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:22.383780 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5872ec-69ce-486a-ab9b-54b0f239d601 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:22.388614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf050d-cb2d-4bf1-b090-56aba515015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:22.389226 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf050d-cb2d-4bf1-b090-56aba515015e admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:22.389509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf050d-cb2d-4bf1-b090-56aba515015e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:22.389815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf050d-cb2d-4bf1-b090-56aba515015e admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:22.390464 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf050d-cb2d-4bf1-b090-56aba515015e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:22.392372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf050d-cb2d-4bf1-b090-56aba515015e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:22.530989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1231/2465] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:35:22 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:22.533526 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52103-4f19-4a14-8015-2f264d6af195 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:22.547438 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52103-4f19-4a14-8015-2f264d6af195 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:22.626575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c65869-f4b5-40ca-8fe5-aebe2333cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:22.626575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c65869-f4b5-40ca-8fe5-aebe2333cee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:22.626575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c65869-f4b5-40ca-8fe5-aebe2333cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:22.626575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c65869-f4b5-40ca-8fe5-aebe2333cee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:22.627191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c65869-f4b5-40ca-8fe5-aebe2333cee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:22.627513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6fed3-b2e3-4c5d-8896-3f1a61c7c9bd None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:22.627700 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c65869-f4b5-40ca-8fe5-aebe2333cee4 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:22.627859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6fed3-b2e3-4c5d-8896-3f1a61c7c9bd None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:22.628020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6fed3-b2e3-4c5d-8896-3f1a61c7c9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:22.650825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-dbf6fed3-b2e3-4c5d-8896-3f1a61c7c9bd None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:22.652079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-dbf6fed3-b2e3-4c5d-8896-3f1a61c7c9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:22.713516 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1232/2466] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 31 19:35:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:35:22.746023 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1235/2467] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:35:22 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:22.750973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6fed3-b2e3-4c5d-8896-3f1a61c7c9bd None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:22.763180 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6fed3-b2e3-4c5d-8896-3f1a61c7c9bd None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:22.768574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dbdd8-376f-461c-93b8-2032689f862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:22.769286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbdd8-376f-461c-93b8-2032689f862a admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:22.769569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbdd8-376f-461c-93b8-2032689f862a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:22.769878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dbdd8-376f-461c-93b8-2032689f862a admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:22.770540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dbdd8-376f-461c-93b8-2032689f862a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:22.772207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dbdd8-376f-461c-93b8-2032689f862a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:22.783626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1233/2468] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:22.788043 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c65869-f4b5-40ca-8fe5-aebe2333cee4 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:22.798293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c65869-f4b5-40ca-8fe5-aebe2333cee4 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:22.803179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef181ad-a7cb-4558-a55e-bbac32a42543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:22.803853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef181ad-a7cb-4558-a55e-bbac32a42543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:22.804134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef181ad-a7cb-4558-a55e-bbac32a42543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:22.804414 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef181ad-a7cb-4558-a55e-bbac32a42543 admin admin] PATH_INFO: `/v3/projects/b6abf313fec14c6485c15b1bcdeec4b0/users/eef464ec9ffe4582a4b27c2d206059ad/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:22.821234 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef181ad-a7cb-4558-a55e-bbac32a42543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6abf313fec14c6485c15b1bcdeec4b0, user_id=eef464ec9ffe4582a4b27c2d206059ad, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:22.824231 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef181ad-a7cb-4558-a55e-bbac32a42543 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:22.959582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dbdd8-376f-461c-93b8-2032689f862a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:22.961614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c03dbdd8-376f-461c-93b8-2032689f862a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:22.968560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1236/2469] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:22 2022] PUT /identity/v3/projects/b6abf313fec14c6485c15b1bcdeec4b0/users/eef464ec9ffe4582a4b27c2d206059ad/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:35:22.968560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef181ad-a7cb-4558-a55e-bbac32a42543 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:23.046074 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef181ad-a7cb-4558-a55e-bbac32a42543 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:23.051241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d126d80-d867-4bf4-946a-7e5cb99ef061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:23.052045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d126d80-d867-4bf4-946a-7e5cb99ef061 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:23.052244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d126d80-d867-4bf4-946a-7e5cb99ef061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:23.052528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d126d80-d867-4bf4-946a-7e5cb99ef061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:23.053205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d126d80-d867-4bf4-946a-7e5cb99ef061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:23.054859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d126d80-d867-4bf4-946a-7e5cb99ef061 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:23.059536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dbdd8-376f-461c-93b8-2032689f862a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:23.069983 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1237/2470] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:35:23.070952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d126d80-d867-4bf4-946a-7e5cb99ef061 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:23.082143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d126d80-d867-4bf4-946a-7e5cb99ef061 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:23.086948 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b419a9-12bf-4d70-ba5a-4cfa7eaf4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:23.087616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b419a9-12bf-4d70-ba5a-4cfa7eaf4a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:23.087891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b419a9-12bf-4d70-ba5a-4cfa7eaf4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:23.088164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b419a9-12bf-4d70-ba5a-4cfa7eaf4a08 admin admin] PATH_INFO: `/v3/projects/b6abf313fec14c6485c15b1bcdeec4b0/users/eef464ec9ffe4582a4b27c2d206059ad/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:23.091951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b419a9-12bf-4d70-ba5a-4cfa7eaf4a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6abf313fec14c6485c15b1bcdeec4b0, user_id=eef464ec9ffe4582a4b27c2d206059ad, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:23.096529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b419a9-12bf-4d70-ba5a-4cfa7eaf4a08 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:23.109930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1238/2471] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:23 2022] PUT /identity/v3/projects/b6abf313fec14c6485c15b1bcdeec4b0/users/eef464ec9ffe4582a4b27c2d206059ad/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:35:23.118521 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb6c9-f9d5-4600-b414-b087ea3d2f1b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:23.119098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb6c9-f9d5-4600-b414-b087ea3d2f1b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:23.119430 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb6c9-f9d5-4600-b414-b087ea3d2f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:23.123768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1ebff-0c45-47bc-83bf-c0116698dbcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:23.124387 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1ebff-0c45-47bc-83bf-c0116698dbcf service swift] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:23.124662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1ebff-0c45-47bc-83bf-c0116698dbcf service swift] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:23.125065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1ebff-0c45-47bc-83bf-c0116698dbcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:23.150621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-b00bb6c9-f9d5-4600-b414-b087ea3d2f1b None None] MFA Rules not processed for user `eef464ec9ffe4582a4b27c2d206059ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:23.152000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b00bb6c9-f9d5-4600-b414-b087ea3d2f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:23.190474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1ebff-0c45-47bc-83bf-c0116698dbcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:23.192204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1ebff-0c45-47bc-83bf-c0116698dbcf service swift] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:23.209398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1234/2472] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:35:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 19:35:23.230000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1239/2473] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:35:23.241568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1ebff-0c45-47bc-83bf-c0116698dbcf service swift] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:23.243119 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2ca1ebff-0c45-47bc-83bf-c0116698dbcf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:23.316083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1ebff-0c45-47bc-83bf-c0116698dbcf service swift] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:23.371903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a6c39-c081-4a7b-952c-24001299e34b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:23.372543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a6c39-c081-4a7b-952c-24001299e34b service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:23.372805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a6c39-c081-4a7b-952c-24001299e34b service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:23.373081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a6c39-c081-4a7b-952c-24001299e34b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:23.383546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a6c39-c081-4a7b-952c-24001299e34b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:23.391904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a6c39-c081-4a7b-952c-24001299e34b service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:23.394928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1235/2474] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:24.921836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bb6c9-f9d5-4600-b414-b087ea3d2f1b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:24.951240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:24.985959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bb6c9-f9d5-4600-b414-b087ea3d2f1b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:24.990523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:24.991169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:24.991444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:24.991718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] PATH_INFO: `/v3/users/37198a56351547da9f86b7680ea6f304` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:24.992855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37198a56351547da9f86b7680ea6f304)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:24.994818 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:25.064131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:25.169696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37198a56351547da9f86b7680ea6f304'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:25.170387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37198a56351547da9f86b7680ea6f304'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:25.170993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37198a56351547da9f86b7680ea6f304'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:25.344683 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37198a56351547da9f86b7680ea6f304'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:25.357464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37198a56351547da9f86b7680ea6f304'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:25.370787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1240/2475] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:24 2022] DELETE /identity/v3/users/37198a56351547da9f86b7680ea6f304 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:25.375257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a37c-f3f4-4d9e-9842-2baa027b6861 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:25.375554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a37c-f3f4-4d9e-9842-2baa027b6861 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:25.376160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a37c-f3f4-4d9e-9842-2baa027b6861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:25.397712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-eab3a37c-f3f4-4d9e-9842-2baa027b6861 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:25.399300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-eab3a37c-f3f4-4d9e-9842-2baa027b6861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:25.459712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1236/2476] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:25.470344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:25.471991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:25.543094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002b637-6438-48af-a49c-effab5fcd835 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:25.546701 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342717f-6c28-42a9-b1e1-48162e4e4a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:25.547630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342717f-6c28-42a9-b1e1-48162e4e4a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:25.547919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342717f-6c28-42a9-b1e1-48162e4e4a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:25.548199 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342717f-6c28-42a9-b1e1-48162e4e4a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:25.558195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342717f-6c28-42a9-b1e1-48162e4e4a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:25.559957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342717f-6c28-42a9-b1e1-48162e4e4a93 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:25.570310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1241/2477] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:26.185272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:26.192855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a37c-f3f4-4d9e-9842-2baa027b6861 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:26.194798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-eab3a37c-f3f4-4d9e-9842-2baa027b6861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:26.211406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a37c-f3f4-4d9e-9842-2baa027b6861 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:26.218998 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:26.222558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:26.222558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:26.222558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] PATH_INFO: `/v3/projects/4f95ba52a72c4db390c812f58758afa1` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:26.222558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f95ba52a72c4db390c812f58758afa1)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:26.225512 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:26.303899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:26.366019 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f95ba52a72c4db390c812f58758afa1', 'request_id': 'req-08302f07-9b63-4aca-91d8-7c8323fff667'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:26.373485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f95ba52a72c4db390c812f58758afa1', 'request_id': 'req-08302f07-9b63-4aca-91d8-7c8323fff667'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:26.514672 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f95ba52a72c4db390c812f58758afa1', 'request_id': 'req-08302f07-9b63-4aca-91d8-7c8323fff667'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:26.527979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] The token cache is being invalidate because project 4f95ba52a72c4db390c812f58758afa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:26.528271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:26.528923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:26.531732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1237/2478] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:26 2022] DELETE /identity/v3/projects/4f95ba52a72c4db390c812f58758afa1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:26.535880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342717f-6c28-42a9-b1e1-48162e4e4a93 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:26.545941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342717f-6c28-42a9-b1e1-48162e4e4a93 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:26.603796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:26.604486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:26.604765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:26.605043 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] PATH_INFO: `/v3/users/eef464ec9ffe4582a4b27c2d206059ad` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:26.606315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef464ec9ffe4582a4b27c2d206059ad)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:26.608272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:26.950572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:26.952270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:27.020798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302f07-9b63-4aca-91d8-7c8323fff667 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:27.026695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839ba7e-41c8-4ce8-ab38-5f99485325d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:27.044843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839ba7e-41c8-4ce8-ab38-5f99485325d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:27.044843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839ba7e-41c8-4ce8-ab38-5f99485325d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:27.044843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839ba7e-41c8-4ce8-ab38-5f99485325d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:27.044843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d839ba7e-41c8-4ce8-ab38-5f99485325d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:27.053621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839ba7e-41c8-4ce8-ab38-5f99485325d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:27.055136 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839ba7e-41c8-4ce8-ab38-5f99485325d4 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:27.065331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1238/2479] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:35:27.127443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef464ec9ffe4582a4b27c2d206059ad'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:27.128954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef464ec9ffe4582a4b27c2d206059ad'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:27.129802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef464ec9ffe4582a4b27c2d206059ad'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:27.331749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef464ec9ffe4582a4b27c2d206059ad'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:27.347364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-03a54237-64fa-40db-b18e-b82d89ab94e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef464ec9ffe4582a4b27c2d206059ad'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:27.361561 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1242/2480] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:26 2022] DELETE /identity/v3/users/eef464ec9ffe4582a4b27c2d206059ad => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:27.658397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:28.025096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839ba7e-41c8-4ce8-ab38-5f99485325d4 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:28.026983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d839ba7e-41c8-4ce8-ab38-5f99485325d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:28.044282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839ba7e-41c8-4ce8-ab38-5f99485325d4 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:28.064689 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:28.122376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:28.123124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:28.123484 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:28.123833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] PATH_INFO: `/v3/projects/b6abf313fec14c6485c15b1bcdeec4b0` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:28.126240 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6abf313fec14c6485c15b1bcdeec4b0)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:28.128702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:28.389440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6abf313fec14c6485c15b1bcdeec4b0', 'request_id': 'req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:28.396679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6abf313fec14c6485c15b1bcdeec4b0', 'request_id': 'req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:28.510170 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6abf313fec14c6485c15b1bcdeec4b0', 'request_id': 'req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:28.525410 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] The token cache is being invalidate because project b6abf313fec14c6485c15b1bcdeec4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:28.525738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:28.526430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-3d8e10d8-1c54-45ea-b04b-1706ebb8fed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:28.528066 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1239/2481] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:28 2022] DELETE /identity/v3/projects/b6abf313fec14c6485c15b1bcdeec4b0 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:28.533184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116357f4-ed06-4458-a599-7b5b4cb79c52 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:28.533856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116357f4-ed06-4458-a599-7b5b4cb79c52 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:28.533856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116357f4-ed06-4458-a599-7b5b4cb79c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:28.555043 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-116357f4-ed06-4458-a599-7b5b4cb79c52 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:28.556258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-116357f4-ed06-4458-a599-7b5b4cb79c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:28.623504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1243/2482] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:35:28.632305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9964a0-674c-44d0-9019-95b4b86a5362 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:28.632777 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9964a0-674c-44d0-9019-95b4b86a5362 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:28.633184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9964a0-674c-44d0-9019-95b4b86a5362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:28.652816 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4d9964a0-674c-44d0-9019-95b4b86a5362 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:28.654064 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4d9964a0-674c-44d0-9019-95b4b86a5362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:28.662420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1240/2483] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:28.666986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116357f4-ed06-4458-a599-7b5b4cb79c52 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:28.677315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116357f4-ed06-4458-a599-7b5b4cb79c52 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:28.682341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8a754-a4c5-493c-b168-a014413f6a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:28.682958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8a754-a4c5-493c-b168-a014413f6a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:28.683238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8a754-a4c5-493c-b168-a014413f6a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:28.683513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8a754-a4c5-493c-b168-a014413f6a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:28.684189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8a754-a4c5-493c-b168-a014413f6a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:35:28.684494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8a754-a4c5-493c-b168-a014413f6a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:28.686316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8a754-a4c5-493c-b168-a014413f6a51 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:28.700183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1244/2484] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:35:28.705434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9964a0-674c-44d0-9019-95b4b86a5362 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:28.720590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9964a0-674c-44d0-9019-95b4b86a5362 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:28.728044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10bfb5-e2c6-4077-967e-18b8aec29cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:28.729082 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10bfb5-e2c6-4077-967e-18b8aec29cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:28.729714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10bfb5-e2c6-4077-967e-18b8aec29cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:28.730321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10bfb5-e2c6-4077-967e-18b8aec29cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:28.731466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10bfb5-e2c6-4077-967e-18b8aec29cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:28.739669 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10bfb5-e2c6-4077-967e-18b8aec29cf2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:28.945721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1241/2485] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:35:28 2022] POST /identity/v3/projects => generated 367 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:28.950180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8a754-a4c5-493c-b168-a014413f6a51 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:28.960765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8a754-a4c5-493c-b168-a014413f6a51 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:29.020955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdf066-601e-40e3-b871-b22bf9fdcac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:29.021562 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdf066-601e-40e3-b871-b22bf9fdcac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:29.021893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdf066-601e-40e3-b871-b22bf9fdcac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:29.022166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdf066-601e-40e3-b871-b22bf9fdcac5 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:29.022807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdf066-601e-40e3-b871-b22bf9fdcac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:29.025564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdf066-601e-40e3-b871-b22bf9fdcac5 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:29.152098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1245/2486] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:35:28 2022] POST /identity/v3/users => generated 284 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:35:29.157241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10bfb5-e2c6-4077-967e-18b8aec29cf2 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:29.172127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10bfb5-e2c6-4077-967e-18b8aec29cf2 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:29.184754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d207a-1dd5-4732-bcdf-47b45897321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:29.185930 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d207a-1dd5-4732-bcdf-47b45897321d admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:29.186552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d207a-1dd5-4732-bcdf-47b45897321d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:29.187049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d207a-1dd5-4732-bcdf-47b45897321d admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:29.188383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d207a-1dd5-4732-bcdf-47b45897321d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:29.190350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d207a-1dd5-4732-bcdf-47b45897321d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:29.206661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1242/2487] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:29.213984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdf066-601e-40e3-b871-b22bf9fdcac5 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:29.226848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdf066-601e-40e3-b871-b22bf9fdcac5 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:29.250612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191f5ab-6de7-4090-8785-7da624ea8024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:29.250612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f5ab-6de7-4090-8785-7da624ea8024 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:29.250612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f5ab-6de7-4090-8785-7da624ea8024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:29.250612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f5ab-6de7-4090-8785-7da624ea8024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:29.251387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191f5ab-6de7-4090-8785-7da624ea8024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:29.251940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191f5ab-6de7-4090-8785-7da624ea8024 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:29.285869 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1246/2488] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:29.286886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d207a-1dd5-4732-bcdf-47b45897321d admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:29.311810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d207a-1dd5-4732-bcdf-47b45897321d admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:29.336247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a98dac-6fad-4960-9e07-237dd112212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:29.336247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a98dac-6fad-4960-9e07-237dd112212f admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:29.336247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a98dac-6fad-4960-9e07-237dd112212f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:29.336247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a98dac-6fad-4960-9e07-237dd112212f admin admin] PATH_INFO: `/v3/projects/9a77c60faa4f4fe190ae76523f86fead/users/bdb6e80b3e04431cb7fe3fa1ff5ac8cc/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:29.357974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a98dac-6fad-4960-9e07-237dd112212f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a77c60faa4f4fe190ae76523f86fead, user_id=bdb6e80b3e04431cb7fe3fa1ff5ac8cc, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:29.362056 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a98dac-6fad-4960-9e07-237dd112212f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:29.492949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1243/2489] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:29 2022] PUT /identity/v3/projects/9a77c60faa4f4fe190ae76523f86fead/users/bdb6e80b3e04431cb7fe3fa1ff5ac8cc/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:29.505292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd470472-7815-4b6c-98fb-38695fac02fb None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:29.505590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd470472-7815-4b6c-98fb-38695fac02fb None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:29.505824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd470472-7815-4b6c-98fb-38695fac02fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:29.561354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-dd470472-7815-4b6c-98fb-38695fac02fb None None] MFA Rules not processed for user `bdb6e80b3e04431cb7fe3fa1ff5ac8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:29.562702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-dd470472-7815-4b6c-98fb-38695fac02fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:29.631705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1247/2490] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:29.636417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a98dac-6fad-4960-9e07-237dd112212f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:29.714600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a98dac-6fad-4960-9e07-237dd112212f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:29.728106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4da17f-3ab1-432f-8e40-12a1285ae06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:29.729034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da17f-3ab1-432f-8e40-12a1285ae06d admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:29.729618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da17f-3ab1-432f-8e40-12a1285ae06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:29.730133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da17f-3ab1-432f-8e40-12a1285ae06d admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:29.731001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4da17f-3ab1-432f-8e40-12a1285ae06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:29.733250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4da17f-3ab1-432f-8e40-12a1285ae06d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:29.861368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1244/2491] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:35:29 2022] POST /identity/v3/projects => generated 367 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:29.865318 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd470472-7815-4b6c-98fb-38695fac02fb None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:29.883608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd470472-7815-4b6c-98fb-38695fac02fb None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:29.904779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:29.946985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d22d-5638-47f3-a544-7a5c423e9258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:29.947596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d22d-5638-47f3-a544-7a5c423e9258 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:29.947878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d22d-5638-47f3-a544-7a5c423e9258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:29.948152 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d22d-5638-47f3-a544-7a5c423e9258 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:29.948783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586d22d-5638-47f3-a544-7a5c423e9258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:29.950748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586d22d-5638-47f3-a544-7a5c423e9258 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:30.108960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1248/2492] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:35:29 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:30.109078 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4da17f-3ab1-432f-8e40-12a1285ae06d admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:30.123126 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4da17f-3ab1-432f-8e40-12a1285ae06d admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:30.128135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69786a0-a064-4f43-9e28-6370a43f1bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:30.128823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69786a0-a064-4f43-9e28-6370a43f1bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:30.129102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69786a0-a064-4f43-9e28-6370a43f1bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:30.129370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69786a0-a064-4f43-9e28-6370a43f1bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:30.130074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69786a0-a064-4f43-9e28-6370a43f1bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:30.131693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69786a0-a064-4f43-9e28-6370a43f1bbd admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:30.143117 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1245/2493] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:30.163720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d22d-5638-47f3-a544-7a5c423e9258 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:30.174601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d22d-5638-47f3-a544-7a5c423e9258 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:30.179733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5968a-2401-40ce-ba9f-abc295879211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:30.180410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5968a-2401-40ce-ba9f-abc295879211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:30.180685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5968a-2401-40ce-ba9f-abc295879211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:30.180959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5968a-2401-40ce-ba9f-abc295879211 admin admin] PATH_INFO: `/v3/projects/93833c48a53a4b85829f881d0279725e/users/fdcbce275b23480994b0f575ad22185d/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:30.199820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5968a-2401-40ce-ba9f-abc295879211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93833c48a53a4b85829f881d0279725e, user_id=fdcbce275b23480994b0f575ad22185d, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:30.202696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5968a-2401-40ce-ba9f-abc295879211 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:30.319567 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1249/2494] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:30 2022] PUT /identity/v3/projects/93833c48a53a4b85829f881d0279725e/users/fdcbce275b23480994b0f575ad22185d/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:30.322685 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69786a0-a064-4f43-9e28-6370a43f1bbd admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:30.335554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69786a0-a064-4f43-9e28-6370a43f1bbd admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:30.399099 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407d924-76bf-43a6-8d45-2930cb902767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:30.399638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407d924-76bf-43a6-8d45-2930cb902767 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:30.399925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407d924-76bf-43a6-8d45-2930cb902767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:30.400202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407d924-76bf-43a6-8d45-2930cb902767 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:30.400856 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407d924-76bf-43a6-8d45-2930cb902767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:30.402536 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407d924-76bf-43a6-8d45-2930cb902767 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:30.416041 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1246/2495] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:30.417202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5968a-2401-40ce-ba9f-abc295879211 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:30.427880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5968a-2401-40ce-ba9f-abc295879211 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:30.432580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf002c3-68cd-4384-809e-09423eb57997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:30.433242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf002c3-68cd-4384-809e-09423eb57997 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:30.433524 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf002c3-68cd-4384-809e-09423eb57997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:30.433871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf002c3-68cd-4384-809e-09423eb57997 admin admin] PATH_INFO: `/v3/projects/93833c48a53a4b85829f881d0279725e/users/fdcbce275b23480994b0f575ad22185d/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:30.435810 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf002c3-68cd-4384-809e-09423eb57997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93833c48a53a4b85829f881d0279725e, user_id=fdcbce275b23480994b0f575ad22185d, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:30.439190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf002c3-68cd-4384-809e-09423eb57997 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:30.450130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1250/2496] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:30 2022] PUT /identity/v3/projects/93833c48a53a4b85829f881d0279725e/users/fdcbce275b23480994b0f575ad22185d/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:30.460545 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e0702-5777-496d-868f-6b67848d1cad None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:30.460845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e0702-5777-496d-868f-6b67848d1cad None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:30.461132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e0702-5777-496d-868f-6b67848d1cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:30.490398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9e9e0702-5777-496d-868f-6b67848d1cad None None] MFA Rules not processed for user `fdcbce275b23480994b0f575ad22185d`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:30.492185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9e9e0702-5777-496d-868f-6b67848d1cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:30.573294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1247/2497] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:30.584633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf002c3-68cd-4384-809e-09423eb57997 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:30.586398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1cf002c3-68cd-4384-809e-09423eb57997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:30.590467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:30.657061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf002c3-68cd-4384-809e-09423eb57997 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:30.661133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d41e0-a77f-4cdb-b773-03d546f12e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:30.662092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d41e0-a77f-4cdb-b773-03d546f12e1c service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:30.662228 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d41e0-a77f-4cdb-b773-03d546f12e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:30.662504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d41e0-a77f-4cdb-b773-03d546f12e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:30.673172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d41e0-a77f-4cdb-b773-03d546f12e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:30.674918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d41e0-a77f-4cdb-b773-03d546f12e1c service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:30.706060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1251/2498] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:32.103652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:34.535192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e0702-5777-496d-868f-6b67848d1cad None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:34.536968 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9e9e0702-5777-496d-868f-6b67848d1cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:34.596624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:34.620409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e0702-5777-496d-868f-6b67848d1cad None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:34.625917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:34.626561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:34.626844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:34.627120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] PATH_INFO: `/v3/users/ff3b344073534df3b64fb708bcb8f746` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:34.628273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3b344073534df3b64fb708bcb8f746)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:34.630228 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:34.826527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d41e0-a77f-4cdb-b773-03d546f12e1c service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:34.837048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d41e0-a77f-4cdb-b773-03d546f12e1c service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:34.841969 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:34.842591 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:34.842871 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:34.843147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] PATH_INFO: `/v3/users/bdb6e80b3e04431cb7fe3fa1ff5ac8cc` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:34.844780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb6e80b3e04431cb7fe3fa1ff5ac8cc)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:34.846762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:34.928298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3b344073534df3b64fb708bcb8f746'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.103035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3b344073534df3b64fb708bcb8f746'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.103588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3b344073534df3b64fb708bcb8f746'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.116496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3b344073534df3b64fb708bcb8f746'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.117160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-088def70-b0dd-4dea-a5eb-5f42da4f4980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3b344073534df3b64fb708bcb8f746'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.128969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1248/2499] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:34 2022] DELETE /identity/v3/users/ff3b344073534df3b64fb708bcb8f746 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:35.221601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb6e80b3e04431cb7fe3fa1ff5ac8cc'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.222299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb6e80b3e04431cb7fe3fa1ff5ac8cc'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.222902 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb6e80b3e04431cb7fe3fa1ff5ac8cc'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.337494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb6e80b3e04431cb7fe3fa1ff5ac8cc'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.350954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb6e80b3e04431cb7fe3fa1ff5ac8cc'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.363693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1252/2500] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:34 2022] DELETE /identity/v3/users/bdb6e80b3e04431cb7fe3fa1ff5ac8cc => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:35:35.368134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408be64-9683-4b95-92cd-26b72f0c48a4 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:35.368425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408be64-9683-4b95-92cd-26b72f0c48a4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:35.368701 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408be64-9683-4b95-92cd-26b72f0c48a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:35.385604 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:35.387260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:35.388632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e408be64-9683-4b95-92cd-26b72f0c48a4 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:35.389997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e408be64-9683-4b95-92cd-26b72f0c48a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:35.430297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:35.456939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1249/2501] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:35.464537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b0282-c63e-49a6-8e1f-c6c4c86c6014 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:35.467323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408be64-9683-4b95-92cd-26b72f0c48a4 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:35.469566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e408be64-9683-4b95-92cd-26b72f0c48a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:35.475545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:35.489402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:35.489402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:35.489402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] PATH_INFO: `/v3/projects/1690ec2f9613408da65f2bf81f6f20e6` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:35.489402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1690ec2f9613408da65f2bf81f6f20e6)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:35.489402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:35.546963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408be64-9683-4b95-92cd-26b72f0c48a4 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:35.551473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13400561-86b1-4352-af6b-775e0a0c59c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:35.554202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13400561-86b1-4352-af6b-775e0a0c59c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:35.554524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13400561-86b1-4352-af6b-775e0a0c59c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:35.554808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13400561-86b1-4352-af6b-775e0a0c59c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:35.565073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13400561-86b1-4352-af6b-775e0a0c59c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:35.566542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13400561-86b1-4352-af6b-775e0a0c59c9 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:35.576716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1250/2502] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:35:35.642884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1690ec2f9613408da65f2bf81f6f20e6', 'request_id': 'req-2b502b72-7bf8-4953-8ab5-a5bfe7718281'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.653297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1690ec2f9613408da65f2bf81f6f20e6', 'request_id': 'req-2b502b72-7bf8-4953-8ab5-a5bfe7718281'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.822069 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1690ec2f9613408da65f2bf81f6f20e6', 'request_id': 'req-2b502b72-7bf8-4953-8ab5-a5bfe7718281'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.834459 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] The token cache is being invalidate because project 1690ec2f9613408da65f2bf81f6f20e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:35.834995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.835377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:35.836970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1253/2503] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:35 2022] DELETE /identity/v3/projects/1690ec2f9613408da65f2bf81f6f20e6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:35:35.840946 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13400561-86b1-4352-af6b-775e0a0c59c9 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:35.851945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13400561-86b1-4352-af6b-775e0a0c59c9 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:35.907475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:35.922646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:35.922646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:35.922646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] PATH_INFO: `/v3/users/e6f1ac1752d84f58bf644a8cd9d0348a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:35.922646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f1ac1752d84f58bf644a8cd9d0348a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:35.922646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:36.168305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:36.169914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:36.190491 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b502b72-7bf8-4953-8ab5-a5bfe7718281 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:36.195953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:36.196714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:36.197185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:36.197484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] PATH_INFO: `/v3/projects/9a77c60faa4f4fe190ae76523f86fead` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:36.198731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a77c60faa4f4fe190ae76523f86fead)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:36.200613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:36.373833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f1ac1752d84f58bf644a8cd9d0348a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:36.430342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a77c60faa4f4fe190ae76523f86fead', 'request_id': 'req-88f34066-7777-4720-947c-8f7f7d54d129'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:36.437134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a77c60faa4f4fe190ae76523f86fead', 'request_id': 'req-88f34066-7777-4720-947c-8f7f7d54d129'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:36.532458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f1ac1752d84f58bf644a8cd9d0348a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:36.533151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f1ac1752d84f58bf644a8cd9d0348a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:36.546058 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f1ac1752d84f58bf644a8cd9d0348a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:36.547442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f1ac1752d84f58bf644a8cd9d0348a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:36.560312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1251/2504] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:35 2022] DELETE /identity/v3/users/e6f1ac1752d84f58bf644a8cd9d0348a => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:36.634816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a77c60faa4f4fe190ae76523f86fead', 'request_id': 'req-88f34066-7777-4720-947c-8f7f7d54d129'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:36.646652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] The token cache is being invalidate because project 9a77c60faa4f4fe190ae76523f86fead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:36.646948 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:36.647597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:36.649383 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1254/2505] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:36 2022] DELETE /identity/v3/projects/9a77c60faa4f4fe190ae76523f86fead => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:35:36.653091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:36.654605 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:36.735960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479eb6f4-9e34-47e8-b9de-7a343a285815 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:36.742190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:36.742863 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:36.743147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:36.743432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] PATH_INFO: `/v3/users/fdcbce275b23480994b0f575ad22185d` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:36.744556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdcbce275b23480994b0f575ad22185d)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:36.746542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:36.882814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:36.884258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:36.950468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f34066-7777-4720-947c-8f7f7d54d129 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:36.954943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:36.955569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:36.955848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:36.956120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] PATH_INFO: `/v3/projects/2a66df094aac4d65a05f0b06ae7a0afe` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:36.957233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a66df094aac4d65a05f0b06ae7a0afe)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:36.959339 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:37.048709 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdcbce275b23480994b0f575ad22185d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:37.166745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a66df094aac4d65a05f0b06ae7a0afe', 'request_id': 'req-4385e59f-0e5b-4679-be9d-d8ba93899277'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:37.173834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a66df094aac4d65a05f0b06ae7a0afe', 'request_id': 'req-4385e59f-0e5b-4679-be9d-d8ba93899277'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:37.188776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdcbce275b23480994b0f575ad22185d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:37.189403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdcbce275b23480994b0f575ad22185d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:37.202349 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdcbce275b23480994b0f575ad22185d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:37.202995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdcbce275b23480994b0f575ad22185d'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:37.215274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1252/2506] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:36 2022] DELETE /identity/v3/users/fdcbce275b23480994b0f575ad22185d => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:37.410504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a66df094aac4d65a05f0b06ae7a0afe', 'request_id': 'req-4385e59f-0e5b-4679-be9d-d8ba93899277'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:37.421648 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] The token cache is being invalidate because project 2a66df094aac4d65a05f0b06ae7a0afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:37.421971 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:37.422637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4385e59f-0e5b-4679-be9d-d8ba93899277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:37.424131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1255/2507] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:36 2022] DELETE /identity/v3/projects/2a66df094aac4d65a05f0b06ae7a0afe => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:35:37.641282 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:37.759473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:37.762850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:37.833629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e3753-8e06-4fe1-941b-65407d6f7067 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:37.838594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:37.838827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:37.839094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:37.839368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] PATH_INFO: `/v3/projects/93833c48a53a4b85829f881d0279725e` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:37.840518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=93833c48a53a4b85829f881d0279725e)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:37.842445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:37.995988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93833c48a53a4b85829f881d0279725e', 'request_id': 'req-e56c69b8-b062-4712-a088-75374a4e40ca'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:38.002175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93833c48a53a4b85829f881d0279725e', 'request_id': 'req-e56c69b8-b062-4712-a088-75374a4e40ca'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:38.097221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93833c48a53a4b85829f881d0279725e', 'request_id': 'req-e56c69b8-b062-4712-a088-75374a4e40ca'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:38.108317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] The token cache is being invalidate because project 93833c48a53a4b85829f881d0279725e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:38.108609 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:38.109233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e56c69b8-b062-4712-a088-75374a4e40ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:38.111329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1253/2508] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:37 2022] DELETE /identity/v3/projects/93833c48a53a4b85829f881d0279725e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:38.116303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798f48-51f3-4136-827d-0e5701c69d59 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:38.116766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798f48-51f3-4136-827d-0e5701c69d59 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:38.116892 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b798f48-51f3-4136-827d-0e5701c69d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:38.137332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-2b798f48-51f3-4136-827d-0e5701c69d59 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:38.138643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2b798f48-51f3-4136-827d-0e5701c69d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:38.197436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1256/2509] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:38.207039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48881b4-7f06-43ac-86f4-21371a8d4f2e None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:38.207039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48881b4-7f06-43ac-86f4-21371a8d4f2e None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:38.207039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48881b4-7f06-43ac-86f4-21371a8d4f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:38.227890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b48881b4-7f06-43ac-86f4-21371a8d4f2e None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:38.235449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b48881b4-7f06-43ac-86f4-21371a8d4f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:38.237183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1254/2510] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:38.241537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b798f48-51f3-4136-827d-0e5701c69d59 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:38.251331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b798f48-51f3-4136-827d-0e5701c69d59 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:38.258337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc79e3-fda6-4edf-a43d-2fb2c8c8bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:38.258337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc79e3-fda6-4edf-a43d-2fb2c8c8bd15 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:38.258337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc79e3-fda6-4edf-a43d-2fb2c8c8bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:38.258337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc79e3-fda6-4edf-a43d-2fb2c8c8bd15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:38.258769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc79e3-fda6-4edf-a43d-2fb2c8c8bd15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:35:38.258769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc79e3-fda6-4edf-a43d-2fb2c8c8bd15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:38.259750 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc79e3-fda6-4edf-a43d-2fb2c8c8bd15 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:38.272060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1257/2511] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:35:38.276573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48881b4-7f06-43ac-86f4-21371a8d4f2e None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:38.291358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48881b4-7f06-43ac-86f4-21371a8d4f2e None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:38.295988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90c645-9309-4d48-9772-7a36381fc9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:38.296591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90c645-9309-4d48-9772-7a36381fc9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:38.296872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90c645-9309-4d48-9772-7a36381fc9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:38.297145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90c645-9309-4d48-9772-7a36381fc9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:38.297910 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90c645-9309-4d48-9772-7a36381fc9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:38.299861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90c645-9309-4d48-9772-7a36381fc9b6 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:38.437018 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1255/2512] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:35:38 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:35:38.441307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc79e3-fda6-4edf-a43d-2fb2c8c8bd15 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:38.451160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc79e3-fda6-4edf-a43d-2fb2c8c8bd15 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:38.507556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a7804-4276-4765-934b-78457e6ca309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:38.508163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a7804-4276-4765-934b-78457e6ca309 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:38.508497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a7804-4276-4765-934b-78457e6ca309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:38.508721 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a7804-4276-4765-934b-78457e6ca309 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:38.509347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a7804-4276-4765-934b-78457e6ca309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:38.511328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a7804-4276-4765-934b-78457e6ca309 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:38.634363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1258/2513] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:35:38 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:38.638728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90c645-9309-4d48-9772-7a36381fc9b6 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:38.645534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:38.650255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90c645-9309-4d48-9772-7a36381fc9b6 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:38.655033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eb0d0-850c-43d0-9a43-633fad4736a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:38.655792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eb0d0-850c-43d0-9a43-633fad4736a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:38.656071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eb0d0-850c-43d0-9a43-633fad4736a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:38.656343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eb0d0-850c-43d0-9a43-633fad4736a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:38.657074 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49eb0d0-850c-43d0-9a43-633fad4736a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:38.658987 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49eb0d0-850c-43d0-9a43-633fad4736a3 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:38.670045 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1256/2514] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:38.674162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a7804-4276-4765-934b-78457e6ca309 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:38.684166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a7804-4276-4765-934b-78457e6ca309 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:38.689483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8997d61-b96c-4f25-85fa-a9b8cf9cd81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:38.690178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8997d61-b96c-4f25-85fa-a9b8cf9cd81d admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:38.690459 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8997d61-b96c-4f25-85fa-a9b8cf9cd81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:38.690729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8997d61-b96c-4f25-85fa-a9b8cf9cd81d admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:38.691375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8997d61-b96c-4f25-85fa-a9b8cf9cd81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:38.693014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8997d61-b96c-4f25-85fa-a9b8cf9cd81d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:38.705911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1259/2515] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:38.710087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eb0d0-850c-43d0-9a43-633fad4736a3 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:38.720128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eb0d0-850c-43d0-9a43-633fad4736a3 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:38.724644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ff9ce-297e-48e8-ac58-208b2c4f1174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:38.725570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ff9ce-297e-48e8-ac58-208b2c4f1174 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:38.725891 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ff9ce-297e-48e8-ac58-208b2c4f1174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:38.730830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ff9ce-297e-48e8-ac58-208b2c4f1174 admin admin] PATH_INFO: `/v3/projects/843b4015345442449ff1a900734a8a35/users/8b085d4518574399b1f0d90afad9146e/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:38.741695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ff9ce-297e-48e8-ac58-208b2c4f1174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843b4015345442449ff1a900734a8a35, user_id=8b085d4518574399b1f0d90afad9146e, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:38.744329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ff9ce-297e-48e8-ac58-208b2c4f1174 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:38.840716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1257/2516] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:38 2022] PUT /identity/v3/projects/843b4015345442449ff1a900734a8a35/users/8b085d4518574399b1f0d90afad9146e/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:35:38.852210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8761e4-07b2-4be1-925c-43457fdf05a3 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:38.852649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8761e4-07b2-4be1-925c-43457fdf05a3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:38.852755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8761e4-07b2-4be1-925c-43457fdf05a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:38.881097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ff8761e4-07b2-4be1-925c-43457fdf05a3 None None] MFA Rules not processed for user `8b085d4518574399b1f0d90afad9146e`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:38.882325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ff8761e4-07b2-4be1-925c-43457fdf05a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:38.946400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1260/2517] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:38.950925 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ff9ce-297e-48e8-ac58-208b2c4f1174 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:39.013059 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ff9ce-297e-48e8-ac58-208b2c4f1174 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:39.017652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18908c-efb3-4a1d-af64-23ae6f9659f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:39.018399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18908c-efb3-4a1d-af64-23ae6f9659f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.018566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18908c-efb3-4a1d-af64-23ae6f9659f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.018842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18908c-efb3-4a1d-af64-23ae6f9659f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.019546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18908c-efb3-4a1d-af64-23ae6f9659f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:39.021352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18908c-efb3-4a1d-af64-23ae6f9659f9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:39.136106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1258/2518] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:35:38 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:39.137588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8761e4-07b2-4be1-925c-43457fdf05a3 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:39.148753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8761e4-07b2-4be1-925c-43457fdf05a3 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:39.207167 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1d09-286d-4e9a-8a5d-e18396f41984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:39.207779 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1d09-286d-4e9a-8a5d-e18396f41984 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.208061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1d09-286d-4e9a-8a5d-e18396f41984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.208337 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1d09-286d-4e9a-8a5d-e18396f41984 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.208984 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1d09-286d-4e9a-8a5d-e18396f41984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:39.210903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad1d09-286d-4e9a-8a5d-e18396f41984 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:39.349958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1261/2519] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:35:39 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:39.354085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18908c-efb3-4a1d-af64-23ae6f9659f9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:39.365720 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18908c-efb3-4a1d-af64-23ae6f9659f9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:39.370824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b43138-efb8-4fa3-997f-a06590b0a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:39.371601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b43138-efb8-4fa3-997f-a06590b0a29e admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.373194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:39.373674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b43138-efb8-4fa3-997f-a06590b0a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.374107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b43138-efb8-4fa3-997f-a06590b0a29e admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.374767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b43138-efb8-4fa3-997f-a06590b0a29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:39.376585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b43138-efb8-4fa3-997f-a06590b0a29e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:39.388222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1259/2520] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:39.392501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1d09-286d-4e9a-8a5d-e18396f41984 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:39.402334 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1d09-286d-4e9a-8a5d-e18396f41984 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:39.407538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05cdf0-2bb2-4cd8-9002-c49e997b1929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:39.408195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05cdf0-2bb2-4cd8-9002-c49e997b1929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.411477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05cdf0-2bb2-4cd8-9002-c49e997b1929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.411477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05cdf0-2bb2-4cd8-9002-c49e997b1929 admin admin] PATH_INFO: `/v3/projects/ba25c20fd39e498680cd9fc61548551a/users/2864687b19f444e2b3bc6a39906e1289/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.424901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05cdf0-2bb2-4cd8-9002-c49e997b1929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba25c20fd39e498680cd9fc61548551a, user_id=2864687b19f444e2b3bc6a39906e1289, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:39.427577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05cdf0-2bb2-4cd8-9002-c49e997b1929 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:39.527109 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1262/2521] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:39 2022] PUT /identity/v3/projects/ba25c20fd39e498680cd9fc61548551a/users/2864687b19f444e2b3bc6a39906e1289/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:39.531687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b43138-efb8-4fa3-997f-a06590b0a29e admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:39.541661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b43138-efb8-4fa3-997f-a06590b0a29e admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:39.597820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410164f-7a8f-447d-bc68-a4ece6079e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:39.598424 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410164f-7a8f-447d-bc68-a4ece6079e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.598716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410164f-7a8f-447d-bc68-a4ece6079e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.598975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410164f-7a8f-447d-bc68-a4ece6079e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.599610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410164f-7a8f-447d-bc68-a4ece6079e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:39.601486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410164f-7a8f-447d-bc68-a4ece6079e85 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:39.612535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1260/2522] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:39.616469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05cdf0-2bb2-4cd8-9002-c49e997b1929 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:39.626644 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05cdf0-2bb2-4cd8-9002-c49e997b1929 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:39.632310 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b28f82-279c-4d99-9d62-49736820aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:39.635505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b28f82-279c-4d99-9d62-49736820aca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.635505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b28f82-279c-4d99-9d62-49736820aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.635505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b28f82-279c-4d99-9d62-49736820aca6 admin admin] PATH_INFO: `/v3/projects/ba25c20fd39e498680cd9fc61548551a/users/2864687b19f444e2b3bc6a39906e1289/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.635505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b28f82-279c-4d99-9d62-49736820aca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba25c20fd39e498680cd9fc61548551a, user_id=2864687b19f444e2b3bc6a39906e1289, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:39.638014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b28f82-279c-4d99-9d62-49736820aca6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:39.648853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1263/2523] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:39 2022] PUT /identity/v3/projects/ba25c20fd39e498680cd9fc61548551a/users/2864687b19f444e2b3bc6a39906e1289/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:39.659750 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ddb7-a760-403a-88a0-257c10484a91 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.660636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ddb7-a760-403a-88a0-257c10484a91 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.660928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862ddb7-a760-403a-88a0-257c10484a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.689676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-7862ddb7-a760-403a-88a0-257c10484a91 None None] MFA Rules not processed for user `2864687b19f444e2b3bc6a39906e1289`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:39.690958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7862ddb7-a760-403a-88a0-257c10484a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:39.758807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1261/2524] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:39.770742 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b28f82-279c-4d99-9d62-49736820aca6 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:39.775778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-20b28f82-279c-4d99-9d62-49736820aca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:39.829525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b28f82-279c-4d99-9d62-49736820aca6 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:39.833191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819335cf-4919-4969-bc3d-57cc578b0f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:39.833819 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819335cf-4919-4969-bc3d-57cc578b0f01 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.834096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819335cf-4919-4969-bc3d-57cc578b0f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.834363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819335cf-4919-4969-bc3d-57cc578b0f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.843140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819335cf-4919-4969-bc3d-57cc578b0f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:39.845211 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819335cf-4919-4969-bc3d-57cc578b0f01 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:39.858313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1264/2525] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:39.885683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ddb7-a760-403a-88a0-257c10484a91 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:39.948965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862ddb7-a760-403a-88a0-257c10484a91 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:39.955328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:39.956990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:39.957641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:39.957963 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:39.958239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] PATH_INFO: `/v3/users/8b085d4518574399b1f0d90afad9146e` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:39.959421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b085d4518574399b1f0d90afad9146e)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:39.961337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:40.317612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b085d4518574399b1f0d90afad9146e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:40.446581 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b085d4518574399b1f0d90afad9146e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:40.447263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b085d4518574399b1f0d90afad9146e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:40.460872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b085d4518574399b1f0d90afad9146e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:40.461742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b085d4518574399b1f0d90afad9146e'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:40.474852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1262/2526] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:39 2022] DELETE /identity/v3/users/8b085d4518574399b1f0d90afad9146e => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:40.479603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378d2b-1f24-4f21-82d6-802dfe1f5491 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:40.480099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378d2b-1f24-4f21-82d6-802dfe1f5491 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:40.480195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378d2b-1f24-4f21-82d6-802dfe1f5491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:40.501106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-68378d2b-1f24-4f21-82d6-802dfe1f5491 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:40.502956 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-68378d2b-1f24-4f21-82d6-802dfe1f5491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:40.596065 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1265/2527] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:40.596628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:40.598666 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:40.684036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0fa47-2d95-44f2-bdf4-a67d24a96729 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:40.684036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8eeb5-9e9d-48bf-be48-d4abb3da2db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:40.684036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8eeb5-9e9d-48bf-be48-d4abb3da2db0 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:40.684036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8eeb5-9e9d-48bf-be48-d4abb3da2db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:40.685131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8eeb5-9e9d-48bf-be48-d4abb3da2db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:40.693336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8eeb5-9e9d-48bf-be48-d4abb3da2db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:40.694967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8eeb5-9e9d-48bf-be48-d4abb3da2db0 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:40.708658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1263/2528] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:40.806362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:41.294340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378d2b-1f24-4f21-82d6-802dfe1f5491 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:41.295782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-68378d2b-1f24-4f21-82d6-802dfe1f5491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:41.308576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378d2b-1f24-4f21-82d6-802dfe1f5491 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:41.314224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:41.314877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:41.315158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:41.315433 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] PATH_INFO: `/v3/projects/843b4015345442449ff1a900734a8a35` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:41.316588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843b4015345442449ff1a900734a8a35)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:41.318579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:41.556727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843b4015345442449ff1a900734a8a35', 'request_id': 'req-82ed8860-728c-4b42-879c-2fd8b6867b97'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:41.563700 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843b4015345442449ff1a900734a8a35', 'request_id': 'req-82ed8860-728c-4b42-879c-2fd8b6867b97'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:41.663317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843b4015345442449ff1a900734a8a35', 'request_id': 'req-82ed8860-728c-4b42-879c-2fd8b6867b97'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:41.674475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] The token cache is being invalidate because project 843b4015345442449ff1a900734a8a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:41.677837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:41.677837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:41.677837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1266/2529] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:41 2022] DELETE /identity/v3/projects/843b4015345442449ff1a900734a8a35 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:41.681192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8eeb5-9e9d-48bf-be48-d4abb3da2db0 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:41.691624 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8eeb5-9e9d-48bf-be48-d4abb3da2db0 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:41.745393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:41.746056 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:41.746339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:41.746617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] PATH_INFO: `/v3/users/2864687b19f444e2b3bc6a39906e1289` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:41.747732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2864687b19f444e2b3bc6a39906e1289)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:41.749643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:42.030665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2864687b19f444e2b3bc6a39906e1289'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:42.160289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2864687b19f444e2b3bc6a39906e1289'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:42.160867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2864687b19f444e2b3bc6a39906e1289'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:42.180080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2864687b19f444e2b3bc6a39906e1289'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:42.181221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b8182e4d-8365-4405-9e10-edc366aec212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2864687b19f444e2b3bc6a39906e1289'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:42.196467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1264/2530] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:41 2022] DELETE /identity/v3/users/2864687b19f444e2b3bc6a39906e1289 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:42.281096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:42.693402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:42.695171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:42.712941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed8860-728c-4b42-879c-2fd8b6867b97 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:42.772769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:42.773450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:42.773766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:42.774044 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] PATH_INFO: `/v3/projects/ba25c20fd39e498680cd9fc61548551a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:42.775169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba25c20fd39e498680cd9fc61548551a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:42.777181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:42.967098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba25c20fd39e498680cd9fc61548551a', 'request_id': 'req-cf350ce1-d267-47c3-857d-a94b6d340789'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:42.971906 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:42.974768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba25c20fd39e498680cd9fc61548551a', 'request_id': 'req-cf350ce1-d267-47c3-857d-a94b6d340789'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:43.085996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba25c20fd39e498680cd9fc61548551a', 'request_id': 'req-cf350ce1-d267-47c3-857d-a94b6d340789'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:43.096978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] The token cache is being invalidate because project ba25c20fd39e498680cd9fc61548551a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:43.112128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:43.112128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-cf350ce1-d267-47c3-857d-a94b6d340789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:43.112128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1267/2531] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:42 2022] DELETE /identity/v3/projects/ba25c20fd39e498680cd9fc61548551a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:43.112437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4a2f8-7b75-43d1-ae6b-3ad901797588 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:43.112437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4a2f8-7b75-43d1-ae6b-3ad901797588 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:43.112437 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4a2f8-7b75-43d1-ae6b-3ad901797588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:43.125440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-77e4a2f8-7b75-43d1-ae6b-3ad901797588 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:43.126680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-77e4a2f8-7b75-43d1-ae6b-3ad901797588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:43.131845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:43.189162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1265/2532] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:43.197267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4e3f6-e905-458d-bd79-227b894fd6b5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:43.198032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4e3f6-e905-458d-bd79-227b894fd6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:43.198032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4e3f6-e905-458d-bd79-227b894fd6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:43.220354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9ad4e3f6-e905-458d-bd79-227b894fd6b5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:43.221751 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9ad4e3f6-e905-458d-bd79-227b894fd6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:43.230029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1268/2533] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:43.234990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4a2f8-7b75-43d1-ae6b-3ad901797588 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:43.244873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4a2f8-7b75-43d1-ae6b-3ad901797588 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:43.249491 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798ceea-981e-4666-b62a-87f2874396ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:43.250622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ceea-981e-4666-b62a-87f2874396ba admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:43.250903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ceea-981e-4666-b62a-87f2874396ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:43.251178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ceea-981e-4666-b62a-87f2874396ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:43.251825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798ceea-981e-4666-b62a-87f2874396ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:35:43.252125 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798ceea-981e-4666-b62a-87f2874396ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:43.253752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798ceea-981e-4666-b62a-87f2874396ba admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:43.266604 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1266/2534] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:35:43.271081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4e3f6-e905-458d-bd79-227b894fd6b5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:43.280758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4e3f6-e905-458d-bd79-227b894fd6b5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:43.286094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e3502-58de-469b-9626-b006e385fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:43.286352 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e3502-58de-469b-9626-b006e385fa50 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:43.286660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e3502-58de-469b-9626-b006e385fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:43.286978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e3502-58de-469b-9626-b006e385fa50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:43.287632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e3502-58de-469b-9626-b006e385fa50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:43.289527 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e3502-58de-469b-9626-b006e385fa50 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:43.442437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1269/2535] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:35:43 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:35:43.446691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798ceea-981e-4666-b62a-87f2874396ba admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:43.456646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798ceea-981e-4666-b62a-87f2874396ba admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:43.509772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:43.514941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2d3e6-63a1-44ea-876a-4f08c5efeda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:43.515693 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d3e6-63a1-44ea-876a-4f08c5efeda0 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:43.515841 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d3e6-63a1-44ea-876a-4f08c5efeda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:43.516165 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d3e6-63a1-44ea-876a-4f08c5efeda0 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:43.516820 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2d3e6-63a1-44ea-876a-4f08c5efeda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:43.518803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2d3e6-63a1-44ea-876a-4f08c5efeda0 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:43.641737 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1267/2536] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:35:43 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:43.646053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e3502-58de-469b-9626-b006e385fa50 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:43.656369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e3502-58de-469b-9626-b006e385fa50 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:43.660860 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb9be-68d8-4ed9-8f2d-6d0552002289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:43.661464 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb9be-68d8-4ed9-8f2d-6d0552002289 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:43.661780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb9be-68d8-4ed9-8f2d-6d0552002289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:43.662059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb9be-68d8-4ed9-8f2d-6d0552002289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:43.662704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb9be-68d8-4ed9-8f2d-6d0552002289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:43.664316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb9be-68d8-4ed9-8f2d-6d0552002289 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:43.675793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1270/2537] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:43.679827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2d3e6-63a1-44ea-876a-4f08c5efeda0 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:43.690738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2d3e6-63a1-44ea-876a-4f08c5efeda0 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:43.695458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cad843-4837-4886-acb4-121689733097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:43.696058 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cad843-4837-4886-acb4-121689733097 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:43.696346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cad843-4837-4886-acb4-121689733097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:43.696621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cad843-4837-4886-acb4-121689733097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:43.697266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cad843-4837-4886-acb4-121689733097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:43.698902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cad843-4837-4886-acb4-121689733097 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:43.709607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1268/2538] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:43.713942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb9be-68d8-4ed9-8f2d-6d0552002289 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:43.724719 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb9be-68d8-4ed9-8f2d-6d0552002289 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:43.729477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5d77c-3259-4530-b011-b57a23d2abb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:43.730156 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5d77c-3259-4530-b011-b57a23d2abb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:43.730465 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5d77c-3259-4530-b011-b57a23d2abb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:43.730749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5d77c-3259-4530-b011-b57a23d2abb1 admin admin] PATH_INFO: `/v3/projects/fa41df5625fb4bf2ac9f091878805dd8/users/d60dd34f91804f8f87abdf3fa2e4caf2/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:43.746046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5d77c-3259-4530-b011-b57a23d2abb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa41df5625fb4bf2ac9f091878805dd8, user_id=d60dd34f91804f8f87abdf3fa2e4caf2, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:43.748727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5d77c-3259-4530-b011-b57a23d2abb1 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:43.840939 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1271/2539] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:43 2022] PUT /identity/v3/projects/fa41df5625fb4bf2ac9f091878805dd8/users/d60dd34f91804f8f87abdf3fa2e4caf2/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:43.853147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53ae3-0289-4b25-96d5-36cd425b75df None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:43.853433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53ae3-0289-4b25-96d5-36cd425b75df None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:43.853742 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b53ae3-0289-4b25-96d5-36cd425b75df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:43.883848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c7b53ae3-0289-4b25-96d5-36cd425b75df None None] MFA Rules not processed for user `d60dd34f91804f8f87abdf3fa2e4caf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:43.885077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c7b53ae3-0289-4b25-96d5-36cd425b75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:43.932453 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:43.952151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1269/2540] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:35:43.956834 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5d77c-3259-4530-b011-b57a23d2abb1 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:44.019962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5d77c-3259-4530-b011-b57a23d2abb1 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:44.025113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cd77c-611d-4962-8d8c-8b839fbb797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:44.029724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cd77c-611d-4962-8d8c-8b839fbb797a admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:44.029724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cd77c-611d-4962-8d8c-8b839fbb797a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:44.029724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cd77c-611d-4962-8d8c-8b839fbb797a admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:44.029724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cd77c-611d-4962-8d8c-8b839fbb797a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:44.029724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cd77c-611d-4962-8d8c-8b839fbb797a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:44.146394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1272/2541] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:35:43 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:44.149913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b53ae3-0289-4b25-96d5-36cd425b75df None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:44.161990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b53ae3-0289-4b25-96d5-36cd425b75df None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:44.213483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:44.220089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1376e-7b3d-4195-beef-e8f5e27a68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:44.220703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1376e-7b3d-4195-beef-e8f5e27a68e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:44.220985 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1376e-7b3d-4195-beef-e8f5e27a68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:44.221260 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1376e-7b3d-4195-beef-e8f5e27a68e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:44.221931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1376e-7b3d-4195-beef-e8f5e27a68e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:44.223836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1376e-7b3d-4195-beef-e8f5e27a68e1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:44.297828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1270/2542] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:35:44 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:44.302042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cd77c-611d-4962-8d8c-8b839fbb797a admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:44.307575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:44.313140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cd77c-611d-4962-8d8c-8b839fbb797a admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:44.319243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a87164-b04d-47b0-8c26-9d0346afd9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:44.319992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87164-b04d-47b0-8c26-9d0346afd9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:44.320280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87164-b04d-47b0-8c26-9d0346afd9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:44.320680 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87164-b04d-47b0-8c26-9d0346afd9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:44.321333 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a87164-b04d-47b0-8c26-9d0346afd9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:44.322971 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a87164-b04d-47b0-8c26-9d0346afd9b4 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:44.335744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1273/2543] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:44.339214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1376e-7b3d-4195-beef-e8f5e27a68e1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:44.351736 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1376e-7b3d-4195-beef-e8f5e27a68e1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:44.357027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a83ff5-0915-44a6-a12e-848ac71c7212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:44.358065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a83ff5-0915-44a6-a12e-848ac71c7212 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:44.358065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a83ff5-0915-44a6-a12e-848ac71c7212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:44.358422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a83ff5-0915-44a6-a12e-848ac71c7212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:44.358880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a83ff5-0915-44a6-a12e-848ac71c7212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:44.360519 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a83ff5-0915-44a6-a12e-848ac71c7212 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:44.370729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1271/2544] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:44.375094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a87164-b04d-47b0-8c26-9d0346afd9b4 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:44.385648 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a87164-b04d-47b0-8c26-9d0346afd9b4 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:44.391437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271b777-4830-49ed-bd9f-e908dc426ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:44.392194 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271b777-4830-49ed-bd9f-e908dc426ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:44.404752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271b777-4830-49ed-bd9f-e908dc426ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:44.404752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271b777-4830-49ed-bd9f-e908dc426ef3 admin admin] PATH_INFO: `/v3/projects/9c828383742149a98b23a630f6ec8de6/users/c13b2496b9b6495b85ce22ebda3cd286/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:44.410338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271b777-4830-49ed-bd9f-e908dc426ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c828383742149a98b23a630f6ec8de6, user_id=c13b2496b9b6495b85ce22ebda3cd286, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:44.413031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271b777-4830-49ed-bd9f-e908dc426ef3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:44.571373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1274/2545] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:44 2022] PUT /identity/v3/projects/9c828383742149a98b23a630f6ec8de6/users/c13b2496b9b6495b85ce22ebda3cd286/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:44.582498 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62209-76ed-45bd-a46a-449c057e05e7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:44.582787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62209-76ed-45bd-a46a-449c057e05e7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:44.583088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62209-76ed-45bd-a46a-449c057e05e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:44.610447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-23d62209-76ed-45bd-a46a-449c057e05e7 None None] MFA Rules not processed for user `c13b2496b9b6495b85ce22ebda3cd286`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:44.611670 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-23d62209-76ed-45bd-a46a-449c057e05e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:44.681351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1272/2546] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:44.686458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271b777-4830-49ed-bd9f-e908dc426ef3 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:44.750697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271b777-4830-49ed-bd9f-e908dc426ef3 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:44.755308 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5210d-d392-42f4-8b60-d31e5f3a633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:44.755908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5210d-d392-42f4-8b60-d31e5f3a633b admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:44.756186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5210d-d392-42f4-8b60-d31e5f3a633b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:44.756458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5210d-d392-42f4-8b60-d31e5f3a633b admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:44.757080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5210d-d392-42f4-8b60-d31e5f3a633b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:44.758998 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5210d-d392-42f4-8b60-d31e5f3a633b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:44.860061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1275/2547] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:35:44 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:44.864223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62209-76ed-45bd-a46a-449c057e05e7 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:44.874826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62209-76ed-45bd-a46a-449c057e05e7 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:44.929842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8463ff-47bd-4932-9fd7-24ac5612b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:44.930452 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8463ff-47bd-4932-9fd7-24ac5612b043 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:44.930734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8463ff-47bd-4932-9fd7-24ac5612b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:44.931012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8463ff-47bd-4932-9fd7-24ac5612b043 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:44.931691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8463ff-47bd-4932-9fd7-24ac5612b043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:44.933550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8463ff-47bd-4932-9fd7-24ac5612b043 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:45.035427 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1273/2548] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:35:44 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:35:45.039513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5210d-d392-42f4-8b60-d31e5f3a633b admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:45.050477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5210d-d392-42f4-8b60-d31e5f3a633b admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:45.055247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f191e-a8d3-4eae-8abb-72804b2c3e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:45.055845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f191e-a8d3-4eae-8abb-72804b2c3e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:45.056125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f191e-a8d3-4eae-8abb-72804b2c3e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:45.056450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f191e-a8d3-4eae-8abb-72804b2c3e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:45.057098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f191e-a8d3-4eae-8abb-72804b2c3e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:45.058725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f191e-a8d3-4eae-8abb-72804b2c3e93 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:45.070461 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1276/2549] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:45.074680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8463ff-47bd-4932-9fd7-24ac5612b043 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:45.084852 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8463ff-47bd-4932-9fd7-24ac5612b043 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:45.091766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cb7c2-bdf3-4e3c-99f4-68bf8d3cadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:45.091766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cb7c2-bdf3-4e3c-99f4-68bf8d3cadbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:45.091766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cb7c2-bdf3-4e3c-99f4-68bf8d3cadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:45.091766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cb7c2-bdf3-4e3c-99f4-68bf8d3cadbb admin admin] PATH_INFO: `/v3/projects/189e017f0f8b44aea3704921b320d8df/users/b4e7cf0c5c054c839924cbfe5c438938/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:45.105509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cb7c2-bdf3-4e3c-99f4-68bf8d3cadbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=189e017f0f8b44aea3704921b320d8df, user_id=b4e7cf0c5c054c839924cbfe5c438938, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:45.108226 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cb7c2-bdf3-4e3c-99f4-68bf8d3cadbb admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:45.189831 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1274/2550] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:45 2022] PUT /identity/v3/projects/189e017f0f8b44aea3704921b320d8df/users/b4e7cf0c5c054c839924cbfe5c438938/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:45.193832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f191e-a8d3-4eae-8abb-72804b2c3e93 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:45.203739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f191e-a8d3-4eae-8abb-72804b2c3e93 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:45.259847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aab799-791f-420d-bc38-528958b9a940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:45.260445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aab799-791f-420d-bc38-528958b9a940 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:45.260727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aab799-791f-420d-bc38-528958b9a940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:45.261004 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aab799-791f-420d-bc38-528958b9a940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:45.261646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aab799-791f-420d-bc38-528958b9a940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:45.263258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aab799-791f-420d-bc38-528958b9a940 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:45.273008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1277/2551] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:35:45.277380 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cb7c2-bdf3-4e3c-99f4-68bf8d3cadbb admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:45.288614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cb7c2-bdf3-4e3c-99f4-68bf8d3cadbb admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:45.293290 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19120-a549-43d1-82ef-4e6925814949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:45.295023 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19120-a549-43d1-82ef-4e6925814949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:45.295660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19120-a549-43d1-82ef-4e6925814949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:45.295942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19120-a549-43d1-82ef-4e6925814949 admin admin] PATH_INFO: `/v3/projects/189e017f0f8b44aea3704921b320d8df/users/b4e7cf0c5c054c839924cbfe5c438938/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:45.298495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e19120-a549-43d1-82ef-4e6925814949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189e017f0f8b44aea3704921b320d8df, user_id=b4e7cf0c5c054c839924cbfe5c438938, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:45.301171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e19120-a549-43d1-82ef-4e6925814949 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:45.312160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1275/2552] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:35:45 2022] PUT /identity/v3/projects/189e017f0f8b44aea3704921b320d8df/users/b4e7cf0c5c054c839924cbfe5c438938/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:45.327387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c84e-30a3-47d3-b062-ee0f2b1cc7c6 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:45.327679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c84e-30a3-47d3-b062-ee0f2b1cc7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:45.327961 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c84e-30a3-47d3-b062-ee0f2b1cc7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:45.357580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c494c84e-30a3-47d3-b062-ee0f2b1cc7c6 None None] MFA Rules not processed for user `b4e7cf0c5c054c839924cbfe5c438938`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:45.358853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c494c84e-30a3-47d3-b062-ee0f2b1cc7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:45.386651 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:45.428264 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1278/2553] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:35:45.439761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19120-a549-43d1-82ef-4e6925814949 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:45.441569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-87e19120-a549-43d1-82ef-4e6925814949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:45.464344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:45.502735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19120-a549-43d1-82ef-4e6925814949 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:45.506407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324339b-5db9-4902-85aa-b9e5b5acdb2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:45.507090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324339b-5db9-4902-85aa-b9e5b5acdb2c service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:45.507438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324339b-5db9-4902-85aa-b9e5b5acdb2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:45.507714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324339b-5db9-4902-85aa-b9e5b5acdb2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:45.517444 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324339b-5db9-4902-85aa-b9e5b5acdb2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:45.520640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324339b-5db9-4902-85aa-b9e5b5acdb2c service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:45.528872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1276/2554] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:46.695354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c84e-30a3-47d3-b062-ee0f2b1cc7c6 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:46.695354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c494c84e-30a3-47d3-b062-ee0f2b1cc7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:46.705659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c84e-30a3-47d3-b062-ee0f2b1cc7c6 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:46.709273 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b3264-2fdb-4199-9d4d-65945668f0db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:46.709911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b3264-2fdb-4199-9d4d-65945668f0db service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:46.710193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b3264-2fdb-4199-9d4d-65945668f0db service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:46.710468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b3264-2fdb-4199-9d4d-65945668f0db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:46.769205 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b3264-2fdb-4199-9d4d-65945668f0db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:46.770752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b3264-2fdb-4199-9d4d-65945668f0db service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:46.779845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1279/2555] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:52.999443 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324339b-5db9-4902-85aa-b9e5b5acdb2c service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:53.019738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324339b-5db9-4902-85aa-b9e5b5acdb2c service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:53.023754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ea330-3df0-42c0-ad90-6add9866def0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:53.024361 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ea330-3df0-42c0-ad90-6add9866def0 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:53.024638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ea330-3df0-42c0-ad90-6add9866def0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:53.024909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ea330-3df0-42c0-ad90-6add9866def0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:53.094158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ea330-3df0-42c0-ad90-6add9866def0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:53.095612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ea330-3df0-42c0-ad90-6add9866def0 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:53.104575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1277/2556] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:56.775757 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=45 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:58.226098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b3264-2fdb-4199-9d4d-65945668f0db service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:58.329146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b3264-2fdb-4199-9d4d-65945668f0db service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:58.334393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:58.335017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:58.335299 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:58.335572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] PATH_INFO: `/v3/users/d60dd34f91804f8f87abdf3fa2e4caf2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:58.336805 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60dd34f91804f8f87abdf3fa2e4caf2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:58.338765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:58.665874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60dd34f91804f8f87abdf3fa2e4caf2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:58.666600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60dd34f91804f8f87abdf3fa2e4caf2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:58.667200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60dd34f91804f8f87abdf3fa2e4caf2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:58.800647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60dd34f91804f8f87abdf3fa2e4caf2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:58.813594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60dd34f91804f8f87abdf3fa2e4caf2'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:58.827574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1280/2557] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:58 2022] DELETE /identity/v3/users/d60dd34f91804f8f87abdf3fa2e4caf2 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:58.832879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892f4c0-d977-4b72-a67c-223aca69a394 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:58.833368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892f4c0-d977-4b72-a67c-223aca69a394 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:58.833565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892f4c0-d977-4b72-a67c-223aca69a394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:58.883843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-8892f4c0-d977-4b72-a67c-223aca69a394 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:35:58.885056 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8892f4c0-d977-4b72-a67c-223aca69a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:58.943860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1278/2558] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:35:58.953590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:58.955072 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:58.995601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:59.021086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b6f6-0bd5-4612-88f9-f15f2bab15c8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:59.025029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420201d2-d41a-41ae-a340-a0abbb5cda07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:59.025633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420201d2-d41a-41ae-a340-a0abbb5cda07 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:59.025947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420201d2-d41a-41ae-a340-a0abbb5cda07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:59.026215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420201d2-d41a-41ae-a340-a0abbb5cda07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:59.035670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420201d2-d41a-41ae-a340-a0abbb5cda07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:59.037093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420201d2-d41a-41ae-a340-a0abbb5cda07 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:59.046972 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1281/2559] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:35:59.511399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892f4c0-d977-4b72-a67c-223aca69a394 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:59.514054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8892f4c0-d977-4b72-a67c-223aca69a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:35:59.526961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892f4c0-d977-4b72-a67c-223aca69a394 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:59.531748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:59.532394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:59.532728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:59.532985 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] PATH_INFO: `/v3/projects/fa41df5625fb4bf2ac9f091878805dd8` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:59.534184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa41df5625fb4bf2ac9f091878805dd8)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:59.536348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:35:59.543463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:59.675171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa41df5625fb4bf2ac9f091878805dd8', 'request_id': 'req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:59.681300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa41df5625fb4bf2ac9f091878805dd8', 'request_id': 'req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:59.749268 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa41df5625fb4bf2ac9f091878805dd8', 'request_id': 'req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:59.761221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] The token cache is being invalidate because project fa41df5625fb4bf2ac9f091878805dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:35:59.761455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:59.762113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:35:59.763615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1279/2560] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:35:59 2022] DELETE /identity/v3/projects/fa41df5625fb4bf2ac9f091878805dd8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:35:59.767652 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420201d2-d41a-41ae-a340-a0abbb5cda07 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:35:59.778068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420201d2-d41a-41ae-a340-a0abbb5cda07 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:35:59.836646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:35:59.837304 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:35:59.837588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:35:59.837903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] PATH_INFO: `/v3/users/c13b2496b9b6495b85ce22ebda3cd286` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:35:59.839053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13b2496b9b6495b85ce22ebda3cd286)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:35:59.841053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:00.067265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13b2496b9b6495b85ce22ebda3cd286'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:00.067840 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13b2496b9b6495b85ce22ebda3cd286'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:00.068474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13b2496b9b6495b85ce22ebda3cd286'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:00.155059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13b2496b9b6495b85ce22ebda3cd286'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:00.169330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13b2496b9b6495b85ce22ebda3cd286'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:00.182253 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1282/2561] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:35:59 2022] DELETE /identity/v3/users/c13b2496b9b6495b85ce22ebda3cd286 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:00.676493 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:00.677985 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:00.692008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e03fc-2dbc-4c50-9d7d-e9435abba9a4 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:00.750341 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:00.750962 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:00.751253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:00.751513 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] PATH_INFO: `/v3/projects/9c828383742149a98b23a630f6ec8de6` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:00.752746 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c828383742149a98b23a630f6ec8de6)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:00.754676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:00.879772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c828383742149a98b23a630f6ec8de6', 'request_id': 'req-926abe27-5ee8-453c-a34b-c7ff1ee84d89'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:00.885949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c828383742149a98b23a630f6ec8de6', 'request_id': 'req-926abe27-5ee8-453c-a34b-c7ff1ee84d89'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:00.953514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c828383742149a98b23a630f6ec8de6', 'request_id': 'req-926abe27-5ee8-453c-a34b-c7ff1ee84d89'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:00.964711 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] The token cache is being invalidate because project 9c828383742149a98b23a630f6ec8de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:36:00.965002 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:00.965627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:00.967129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1280/2562] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:36:00 2022] DELETE /identity/v3/projects/9c828383742149a98b23a630f6ec8de6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:00.971067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:00.972493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:00.985349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c004c21-a25d-4a25-9632-2198224210e9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:01.035610 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:01.043401 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:01.044157 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:01.044463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:01.044745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] PATH_INFO: `/v3/users/b4e7cf0c5c054c839924cbfe5c438938` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:01.045967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e7cf0c5c054c839924cbfe5c438938)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:01.047904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:01.247287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e7cf0c5c054c839924cbfe5c438938'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:01.247882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e7cf0c5c054c839924cbfe5c438938'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:01.248484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e7cf0c5c054c839924cbfe5c438938'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:01.355045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e7cf0c5c054c839924cbfe5c438938'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:01.367463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-0ec5d882-0993-4368-825d-dd9f12c8ca66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e7cf0c5c054c839924cbfe5c438938'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:01.379654 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1283/2563] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:36:00 2022] DELETE /identity/v3/users/b4e7cf0c5c054c839924cbfe5c438938 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:01.819129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:01.820670 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:01.834222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926abe27-5ee8-453c-a34b-c7ff1ee84d89 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:01.855879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:01.891913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:01.892538 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:01.892819 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:01.893091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] PATH_INFO: `/v3/projects/189e017f0f8b44aea3704921b320d8df` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:01.894224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189e017f0f8b44aea3704921b320d8df)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:01.899732 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:02.034185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189e017f0f8b44aea3704921b320d8df', 'request_id': 'req-05240553-9fd1-4cdc-8409-a555b6d32e95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:02.040851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189e017f0f8b44aea3704921b320d8df', 'request_id': 'req-05240553-9fd1-4cdc-8409-a555b6d32e95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:02.114438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189e017f0f8b44aea3704921b320d8df', 'request_id': 'req-05240553-9fd1-4cdc-8409-a555b6d32e95'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:02.124954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] The token cache is being invalidate because project 189e017f0f8b44aea3704921b320d8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:36:02.125241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:02.125912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-05240553-9fd1-4cdc-8409-a555b6d32e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:36:02.129366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1281/2564] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:36:01 2022] DELETE /identity/v3/projects/189e017f0f8b44aea3704921b320d8df => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:02.134113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6428f-580b-4b76-9802-6d97ee0a08fe None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:02.134580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6428f-580b-4b76-9802-6d97ee0a08fe None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:02.134689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6428f-580b-4b76-9802-6d97ee0a08fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:02.183458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-19f6428f-580b-4b76-9802-6d97ee0a08fe None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:02.184658 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-19f6428f-580b-4b76-9802-6d97ee0a08fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:02.242475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1284/2565] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:02.250949 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2cc1-4b59-4c51-8365-51d3ccee8313 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:02.251253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2cc1-4b59-4c51-8365-51d3ccee8313 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:02.251539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2cc1-4b59-4c51-8365-51d3ccee8313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:02.272752 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-204c2cc1-4b59-4c51-8365-51d3ccee8313 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:02.273989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-204c2cc1-4b59-4c51-8365-51d3ccee8313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:02.281957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1282/2566] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:02.286120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6428f-580b-4b76-9802-6d97ee0a08fe None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:02.295747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6428f-580b-4b76-9802-6d97ee0a08fe None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:02.300344 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf863a1a-d67b-4a80-a54b-2dcd45d2385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:02.300937 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf863a1a-d67b-4a80-a54b-2dcd45d2385c admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:02.301223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf863a1a-d67b-4a80-a54b-2dcd45d2385c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:02.301501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf863a1a-d67b-4a80-a54b-2dcd45d2385c admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:02.302221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf863a1a-d67b-4a80-a54b-2dcd45d2385c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:36:02.302529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf863a1a-d67b-4a80-a54b-2dcd45d2385c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:02.304119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf863a1a-d67b-4a80-a54b-2dcd45d2385c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:02.315597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1285/2567] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:36:02.320754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c2cc1-4b59-4c51-8365-51d3ccee8313 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:02.329941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c2cc1-4b59-4c51-8365-51d3ccee8313 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:02.335163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ef4e7-bf58-431c-84bd-45300a48e7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:02.335758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ef4e7-bf58-431c-84bd-45300a48e7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:02.336040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ef4e7-bf58-431c-84bd-45300a48e7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:02.336310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ef4e7-bf58-431c-84bd-45300a48e7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:02.336954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ef4e7-bf58-431c-84bd-45300a48e7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:02.338869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ef4e7-bf58-431c-84bd-45300a48e7a2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:02.498434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1283/2568] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:36:02 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:36:02.502636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf863a1a-d67b-4a80-a54b-2dcd45d2385c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:02.513503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf863a1a-d67b-4a80-a54b-2dcd45d2385c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:02.543454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:02.571854 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf34617-a297-4b61-a755-d00003f9b1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:02.572458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf34617-a297-4b61-a755-d00003f9b1ff admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:02.572735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf34617-a297-4b61-a755-d00003f9b1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:02.573009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf34617-a297-4b61-a755-d00003f9b1ff admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:02.573631 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf34617-a297-4b61-a755-d00003f9b1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:02.575597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf34617-a297-4b61-a755-d00003f9b1ff admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:02.721177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1286/2569] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:36:02 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:36:02.725307 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ef4e7-bf58-431c-84bd-45300a48e7a2 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:02.735585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ef4e7-bf58-431c-84bd-45300a48e7a2 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:02.740546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cff84-75de-42ba-b7c2-56e49294c9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:02.741146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cff84-75de-42ba-b7c2-56e49294c9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:02.741429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cff84-75de-42ba-b7c2-56e49294c9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:02.741731 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cff84-75de-42ba-b7c2-56e49294c9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:02.742378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cff84-75de-42ba-b7c2-56e49294c9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:02.743961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cff84-75de-42ba-b7c2-56e49294c9d2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:02.753896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1284/2570] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:36:02.758582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf34617-a297-4b61-a755-d00003f9b1ff admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:02.769621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf34617-a297-4b61-a755-d00003f9b1ff admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:02.774363 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f00e2-7c36-4c7c-93ec-b09ccd9c3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:02.774957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f00e2-7c36-4c7c-93ec-b09ccd9c3cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:02.775258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f00e2-7c36-4c7c-93ec-b09ccd9c3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:02.775556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f00e2-7c36-4c7c-93ec-b09ccd9c3cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:02.776192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f00e2-7c36-4c7c-93ec-b09ccd9c3cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:02.777885 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f00e2-7c36-4c7c-93ec-b09ccd9c3cc6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:02.787893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1287/2571] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:36:02.791841 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cff84-75de-42ba-b7c2-56e49294c9d2 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:02.802363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cff84-75de-42ba-b7c2-56e49294c9d2 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:02.806896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25040c53-833c-4ad0-9fe1-7483a9e59037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:02.809479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25040c53-833c-4ad0-9fe1-7483a9e59037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:02.809479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25040c53-833c-4ad0-9fe1-7483a9e59037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:02.809479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25040c53-833c-4ad0-9fe1-7483a9e59037 admin admin] PATH_INFO: `/v3/projects/a7f7326b23264c6396d88c68167e3697/users/ff70e1990027404d8c77332998b35685/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:02.824524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25040c53-833c-4ad0-9fe1-7483a9e59037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f7326b23264c6396d88c68167e3697, user_id=ff70e1990027404d8c77332998b35685, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:02.826976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25040c53-833c-4ad0-9fe1-7483a9e59037 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:02.936682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1285/2572] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:36:02 2022] PUT /identity/v3/projects/a7f7326b23264c6396d88c68167e3697/users/ff70e1990027404d8c77332998b35685/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:02.941974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c10fa-dfe9-48f5-9bef-af71d80afb8a None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:02.942260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c10fa-dfe9-48f5-9bef-af71d80afb8a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:02.942546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c10fa-dfe9-48f5-9bef-af71d80afb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:02.961733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-3f0c10fa-dfe9-48f5-9bef-af71d80afb8a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:02.962933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3f0c10fa-dfe9-48f5-9bef-af71d80afb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:03.023511 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1288/2573] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:03.034695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25040c53-833c-4ad0-9fe1-7483a9e59037 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:03.037207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-25040c53-833c-4ad0-9fe1-7483a9e59037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:03.091590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:03.095408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25040c53-833c-4ad0-9fe1-7483a9e59037 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:03.099606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebf7ab-5867-496f-8092-35abbe0d3268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:03.100200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebf7ab-5867-496f-8092-35abbe0d3268 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:03.100476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebf7ab-5867-496f-8092-35abbe0d3268 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:03.103476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebf7ab-5867-496f-8092-35abbe0d3268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:03.109825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebf7ab-5867-496f-8092-35abbe0d3268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:03.111243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebf7ab-5867-496f-8092-35abbe0d3268 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:03.121094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1286/2574] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:36:04.650613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a0450-4256-4312-8386-24cbcdc107b3 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:04.651207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a0450-4256-4312-8386-24cbcdc107b3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:04.651207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a0450-4256-4312-8386-24cbcdc107b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:04.681924 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-fb3a0450-4256-4312-8386-24cbcdc107b3 None None] MFA Rules not processed for user `ff70e1990027404d8c77332998b35685`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:04.683520 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fb3a0450-4256-4312-8386-24cbcdc107b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:04.752732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1289/2575] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:04.762675 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebf7ab-5867-496f-8092-35abbe0d3268 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:04.774330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebf7ab-5867-496f-8092-35abbe0d3268 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:04.779381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a900a-55d3-4873-a016-a5c3d17811ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:04.779979 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a900a-55d3-4873-a016-a5c3d17811ca admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:04.780267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a900a-55d3-4873-a016-a5c3d17811ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:04.780544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a900a-55d3-4873-a016-a5c3d17811ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:04.781181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a900a-55d3-4873-a016-a5c3d17811ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:04.783216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a900a-55d3-4873-a016-a5c3d17811ca admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:04.887763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1287/2576] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:36:04 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:36:04.891836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a0450-4256-4312-8386-24cbcdc107b3 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:04.903021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a0450-4256-4312-8386-24cbcdc107b3 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:04.943084 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:04.960348 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824a7b4-efbf-4540-bcf4-7d80823e0718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:04.960958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a7b4-efbf-4540-bcf4-7d80823e0718 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:04.961244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a7b4-efbf-4540-bcf4-7d80823e0718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:04.961543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a7b4-efbf-4540-bcf4-7d80823e0718 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:04.962190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824a7b4-efbf-4540-bcf4-7d80823e0718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:04.964085 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824a7b4-efbf-4540-bcf4-7d80823e0718 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:05.102730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1290/2577] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:36:04 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:36:05.106879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a900a-55d3-4873-a016-a5c3d17811ca admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:05.117370 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a900a-55d3-4873-a016-a5c3d17811ca admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:05.122121 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95311e1-f071-4256-9072-c509f9a634a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:05.122747 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95311e1-f071-4256-9072-c509f9a634a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:05.123026 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95311e1-f071-4256-9072-c509f9a634a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:05.123300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95311e1-f071-4256-9072-c509f9a634a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:05.123936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95311e1-f071-4256-9072-c509f9a634a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:05.125615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95311e1-f071-4256-9072-c509f9a634a5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:05.136887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1288/2578] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:36:05.141160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824a7b4-efbf-4540-bcf4-7d80823e0718 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:05.151543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824a7b4-efbf-4540-bcf4-7d80823e0718 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:05.156026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443fc3-ce22-41bc-b3dc-1b6ba6be56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:05.156663 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443fc3-ce22-41bc-b3dc-1b6ba6be56ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:05.156941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443fc3-ce22-41bc-b3dc-1b6ba6be56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:05.157214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443fc3-ce22-41bc-b3dc-1b6ba6be56ee admin admin] PATH_INFO: `/v3/projects/133c4d5fb3f24253878d67c73aacaeb7/users/c81a5f3038d9429fa033d96ae9ed37e6/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:05.171889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08443fc3-ce22-41bc-b3dc-1b6ba6be56ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=133c4d5fb3f24253878d67c73aacaeb7, user_id=c81a5f3038d9429fa033d96ae9ed37e6, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:05.174800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08443fc3-ce22-41bc-b3dc-1b6ba6be56ee admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:05.264106 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1291/2579] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:36:05 2022] PUT /identity/v3/projects/133c4d5fb3f24253878d67c73aacaeb7/users/c81a5f3038d9429fa033d96ae9ed37e6/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:05.268197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95311e1-f071-4256-9072-c509f9a634a5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:05.278800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95311e1-f071-4256-9072-c509f9a634a5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:05.334295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f587bac-ba78-41eb-9f9f-1afe41de32be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:05.334917 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f587bac-ba78-41eb-9f9f-1afe41de32be admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:05.335187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f587bac-ba78-41eb-9f9f-1afe41de32be admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:05.335464 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f587bac-ba78-41eb-9f9f-1afe41de32be admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:05.336337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f587bac-ba78-41eb-9f9f-1afe41de32be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:05.338255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f587bac-ba78-41eb-9f9f-1afe41de32be admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:05.349430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1289/2580] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:36:05.358669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443fc3-ce22-41bc-b3dc-1b6ba6be56ee admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:05.365517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443fc3-ce22-41bc-b3dc-1b6ba6be56ee admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:05.370627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32044364-a7b4-4801-a5cc-d430a31aaca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:05.371346 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32044364-a7b4-4801-a5cc-d430a31aaca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:05.371605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32044364-a7b4-4801-a5cc-d430a31aaca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:05.371882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32044364-a7b4-4801-a5cc-d430a31aaca4 admin admin] PATH_INFO: `/v3/projects/133c4d5fb3f24253878d67c73aacaeb7/users/c81a5f3038d9429fa033d96ae9ed37e6/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:05.373859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32044364-a7b4-4801-a5cc-d430a31aaca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=133c4d5fb3f24253878d67c73aacaeb7, user_id=c81a5f3038d9429fa033d96ae9ed37e6, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:05.376534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32044364-a7b4-4801-a5cc-d430a31aaca4 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:05.387240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1292/2581] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:36:05 2022] PUT /identity/v3/projects/133c4d5fb3f24253878d67c73aacaeb7/users/c81a5f3038d9429fa033d96ae9ed37e6/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:36:07.083008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca8520-1aa8-4d39-99d4-2c3452c36ff7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:07.083569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca8520-1aa8-4d39-99d4-2c3452c36ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:07.083569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca8520-1aa8-4d39-99d4-2c3452c36ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:07.115026 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-eeca8520-1aa8-4d39-99d4-2c3452c36ff7 None None] MFA Rules not processed for user `c81a5f3038d9429fa033d96ae9ed37e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:07.116272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-eeca8520-1aa8-4d39-99d4-2c3452c36ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:07.190943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1290/2582] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:07.203341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350412-6abd-493c-9bf5-6c35b9781dcb None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:07.209693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350412-6abd-493c-9bf5-6c35b9781dcb None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:07.209693 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350412-6abd-493c-9bf5-6c35b9781dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:07.224512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-56350412-6abd-493c-9bf5-6c35b9781dcb None None] MFA Rules not processed for user `ff70e1990027404d8c77332998b35685`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:07.225765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-56350412-6abd-493c-9bf5-6c35b9781dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:07.281021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1293/2583] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:07.293346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca8520-1aa8-4d39-99d4-2c3452c36ff7 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:07.294800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-eeca8520-1aa8-4d39-99d4-2c3452c36ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:07.341043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:07.399843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca8520-1aa8-4d39-99d4-2c3452c36ff7 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:07.406955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975af3b-67bb-4436-bb5a-4b494649a896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:07.407588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975af3b-67bb-4436-bb5a-4b494649a896 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:07.407871 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975af3b-67bb-4436-bb5a-4b494649a896 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:07.408144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975af3b-67bb-4436-bb5a-4b494649a896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:07.417040 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975af3b-67bb-4436-bb5a-4b494649a896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:07.418651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975af3b-67bb-4436-bb5a-4b494649a896 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:07.428300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1291/2584] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:36:17.274514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=50,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:17.835050 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=28 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:27.376382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350654c-8b25-467a-9ed5-b02d2aa7bee5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:27.376875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350654c-8b25-467a-9ed5-b02d2aa7bee5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:27.377009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350654c-8b25-467a-9ed5-b02d2aa7bee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:27.407353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-0350654c-8b25-467a-9ed5-b02d2aa7bee5 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:27.408460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0350654c-8b25-467a-9ed5-b02d2aa7bee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:27.468927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1294/2585] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:27.686030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975af3b-67bb-4436-bb5a-4b494649a896 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:27.687471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9975af3b-67bb-4436-bb5a-4b494649a896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:27.772947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975af3b-67bb-4436-bb5a-4b494649a896 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:27.778973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf89fff-f24e-4e84-84e6-36fc6bc9e62e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:27.779818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf89fff-f24e-4e84-84e6-36fc6bc9e62e service swift] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:27.780192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf89fff-f24e-4e84-84e6-36fc6bc9e62e service swift] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:27.780601 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf89fff-f24e-4e84-84e6-36fc6bc9e62e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:27.791308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf89fff-f24e-4e84-84e6-36fc6bc9e62e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:27.792906 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf89fff-f24e-4e84-84e6-36fc6bc9e62e service swift] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:27.801447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1292/2586] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:27.804640 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350654c-8b25-467a-9ed5-b02d2aa7bee5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:27.806670 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-0350654c-8b25-467a-9ed5-b02d2aa7bee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:27.885913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350654c-8b25-467a-9ed5-b02d2aa7bee5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:27.891621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c74e84-1a7f-410d-a8d4-8210ea911686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:27.892325 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c74e84-1a7f-410d-a8d4-8210ea911686 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:27.892536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c74e84-1a7f-410d-a8d4-8210ea911686 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:27.892814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c74e84-1a7f-410d-a8d4-8210ea911686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:27.905302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c74e84-1a7f-410d-a8d4-8210ea911686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:27.906932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c74e84-1a7f-410d-a8d4-8210ea911686 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:27.919404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1295/2587] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:36:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:36:37.798035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=32 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:37.913964 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=55 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:53.437838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41836ee-b033-40de-9538-b73625d6d8e1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:53.438330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41836ee-b033-40de-9538-b73625d6d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:53.438424 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41836ee-b033-40de-9538-b73625d6d8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:53.458080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a41836ee-b033-40de-9538-b73625d6d8e1 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:36:53.459271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a41836ee-b033-40de-9538-b73625d6d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:36:53.466422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1293/2588] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:36:53.478559 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c74e84-1a7f-410d-a8d4-8210ea911686 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:36:53.489796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c74e84-1a7f-410d-a8d4-8210ea911686 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:36:53.495270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2a3fc-5380-4185-b23d-5c55763050b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:36:53.507499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2a3fc-5380-4185-b23d-5c55763050b6 service swift] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:36:53.507499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2a3fc-5380-4185-b23d-5c55763050b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:36:53.507499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2a3fc-5380-4185-b23d-5c55763050b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:36:53.507499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2a3fc-5380-4185-b23d-5c55763050b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:36:53.507875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2a3fc-5380-4185-b23d-5c55763050b6 service swift] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:36:53.516017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1296/2589] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:36:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:37:00.864729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664541-8a0e-4f8c-adb8-91cc06ddd7e8 None None] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:00.864729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664541-8a0e-4f8c-adb8-91cc06ddd7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:00.864729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664541-8a0e-4f8c-adb8-91cc06ddd7e8 None None] PATH_INFO: `/` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:00.866064 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1294/2590] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 31 19:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:37:00.905329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c1118-5861-445f-a70d-6407db8da7d5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:00.905940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c1118-5861-445f-a70d-6407db8da7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:00.905940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c1118-5861-445f-a70d-6407db8da7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:00.970982 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-450c1118-5861-445f-a70d-6407db8da7d5 None None] MFA Rules not processed for user `b98cb3da3efe49acbfe640366bf7b53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:00.972361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-450c1118-5861-445f-a70d-6407db8da7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:01.055823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1297/2591] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 31 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:01.067471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28664541-8a0e-4f8c-adb8-91cc06ddd7e8 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:01.069914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-28664541-8a0e-4f8c-adb8-91cc06ddd7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:01.088580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28664541-8a0e-4f8c-adb8-91cc06ddd7e8 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:01.095474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc70eee-ed82-4490-aba2-997dbdda4ef0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:01.095474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc70eee-ed82-4490-aba2-997dbdda4ef0 service placement] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:01.095474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc70eee-ed82-4490-aba2-997dbdda4ef0 service placement] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:01.095474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc70eee-ed82-4490-aba2-997dbdda4ef0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:01.104766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc70eee-ed82-4490-aba2-997dbdda4ef0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:01.106500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc70eee-ed82-4490-aba2-997dbdda4ef0 service placement] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:01.120368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1295/2592] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:01.934086 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c1118-5861-445f-a70d-6407db8da7d5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:01.999238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c1118-5861-445f-a70d-6407db8da7d5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:02.003729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:02.004361 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:02.004643 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:02.004917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] PATH_INFO: `/v3/users/ff70e1990027404d8c77332998b35685` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:02.006056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff70e1990027404d8c77332998b35685)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:02.007988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:02.202673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff70e1990027404d8c77332998b35685'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:02.203384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff70e1990027404d8c77332998b35685'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:02.203988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff70e1990027404d8c77332998b35685'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:02.207794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:02.302358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff70e1990027404d8c77332998b35685'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:02.316005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff70e1990027404d8c77332998b35685'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:02.328950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1298/2593] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:37:01 2022] DELETE /identity/v3/users/ff70e1990027404d8c77332998b35685 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:02.613114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc70eee-ed82-4490-aba2-997dbdda4ef0 service placement] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:02.629773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc70eee-ed82-4490-aba2-997dbdda4ef0 service placement] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:02.683382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:02.687057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:02.687057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:02.687057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] PATH_INFO: `/v3/projects/a7f7326b23264c6396d88c68167e3697` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:02.687057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f7326b23264c6396d88c68167e3697)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:02.687823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:02.792539 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f7326b23264c6396d88c68167e3697', 'request_id': 'req-020d0eeb-0683-4e74-a822-e2de26ce03c2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:02.799244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f7326b23264c6396d88c68167e3697', 'request_id': 'req-020d0eeb-0683-4e74-a822-e2de26ce03c2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:02.914263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f7326b23264c6396d88c68167e3697', 'request_id': 'req-020d0eeb-0683-4e74-a822-e2de26ce03c2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:02.925415 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] The token cache is being invalidate because project a7f7326b23264c6396d88c68167e3697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:37:02.925735 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:02.926419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:02.927908 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1296/2594] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:37:02 2022] DELETE /identity/v3/projects/a7f7326b23264c6396d88c68167e3697 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:02.937298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:02.938908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:02.952453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2893f7-753c-4f9f-90fa-386cea1a3175 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:03.013447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:03.014115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:03.014495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:03.014783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] PATH_INFO: `/v3/users/c81a5f3038d9429fa033d96ae9ed37e6` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:03.015930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81a5f3038d9429fa033d96ae9ed37e6)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:03.017880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:03.215940 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81a5f3038d9429fa033d96ae9ed37e6'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:03.216579 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81a5f3038d9429fa033d96ae9ed37e6'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:03.217171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81a5f3038d9429fa033d96ae9ed37e6'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:03.330513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81a5f3038d9429fa033d96ae9ed37e6'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:03.343769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ffe3f93f-cf7f-4dd9-a5df-8fd3556f72ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81a5f3038d9429fa033d96ae9ed37e6'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:03.357791 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1299/2595] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:37:02 2022] DELETE /identity/v3/users/c81a5f3038d9429fa033d96ae9ed37e6 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:03.616951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:03.616951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:03.629951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d0eeb-0683-4e74-a822-e2de26ce03c2 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:03.687298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:03.687936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:03.688216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:03.688490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] PATH_INFO: `/v3/projects/133c4d5fb3f24253878d67c73aacaeb7` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:03.689606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=133c4d5fb3f24253878d67c73aacaeb7)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:03.691529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:03.703358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:03.818953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133c4d5fb3f24253878d67c73aacaeb7', 'request_id': 'req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:03.827905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133c4d5fb3f24253878d67c73aacaeb7', 'request_id': 'req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:03.938129 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133c4d5fb3f24253878d67c73aacaeb7', 'request_id': 'req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:03.950476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] The token cache is being invalidate because project 133c4d5fb3f24253878d67c73aacaeb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:37:03.950835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:03.951564 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-d0059cf2-1ce7-4ba0-be51-56d76a0b13a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:03.953137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1297/2596] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:37:03 2022] DELETE /identity/v3/projects/133c4d5fb3f24253878d67c73aacaeb7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:03.958019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d267-3425-4376-b636-e20148490a81 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:03.958512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d267-3425-4376-b636-e20148490a81 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:03.958613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d267-3425-4376-b636-e20148490a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:03.980374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-48e3d267-3425-4376-b636-e20148490a81 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:03.981590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-48e3d267-3425-4376-b636-e20148490a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:04.035061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:04.049756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1300/2597] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:04.057847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5223fc-5618-48b6-a9b1-bc7f2c58ed31 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:04.058123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5223fc-5618-48b6-a9b1-bc7f2c58ed31 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:04.058395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5223fc-5618-48b6-a9b1-bc7f2c58ed31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:04.079981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-1a5223fc-5618-48b6-a9b1-bc7f2c58ed31 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:04.081130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1a5223fc-5618-48b6-a9b1-bc7f2c58ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:04.089740 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1298/2598] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:04.094229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3d267-3425-4376-b636-e20148490a81 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:04.104168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3d267-3425-4376-b636-e20148490a81 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:04.108743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8438f-2e7b-422b-be3d-7ab45d2de04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:04.113859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8438f-2e7b-422b-be3d-7ab45d2de04b admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:04.113859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8438f-2e7b-422b-be3d-7ab45d2de04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:04.113859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8438f-2e7b-422b-be3d-7ab45d2de04b admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:04.113859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8438f-2e7b-422b-be3d-7ab45d2de04b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:37:04.113859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8438f-2e7b-422b-be3d-7ab45d2de04b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:04.113859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8438f-2e7b-422b-be3d-7ab45d2de04b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:04.123809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1301/2599] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:37:04.128955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5223fc-5618-48b6-a9b1-bc7f2c58ed31 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:04.138652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5223fc-5618-48b6-a9b1-bc7f2c58ed31 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:04.143267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c6b34-0e04-45f7-bd6f-6f8677123653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:04.148288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6b34-0e04-45f7-bd6f-6f8677123653 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:04.148288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6b34-0e04-45f7-bd6f-6f8677123653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:04.148288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6b34-0e04-45f7-bd6f-6f8677123653 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:04.148288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c6b34-0e04-45f7-bd6f-6f8677123653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:04.148288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c6b34-0e04-45f7-bd6f-6f8677123653 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:04.242707 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1299/2600] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:37:04 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:04.246962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8438f-2e7b-422b-be3d-7ab45d2de04b admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:04.257568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8438f-2e7b-422b-be3d-7ab45d2de04b admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:04.312955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a6b0f-0f8f-4940-8f4a-b90f4adf2ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:04.313569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a6b0f-0f8f-4940-8f4a-b90f4adf2ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:04.313867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a6b0f-0f8f-4940-8f4a-b90f4adf2ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:04.314139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a6b0f-0f8f-4940-8f4a-b90f4adf2ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:04.314758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a6b0f-0f8f-4940-8f4a-b90f4adf2ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:04.316714 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a6b0f-0f8f-4940-8f4a-b90f4adf2ee8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:04.485408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1302/2601] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:37:04 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:04.489595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c6b34-0e04-45f7-bd6f-6f8677123653 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:04.500231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c6b34-0e04-45f7-bd6f-6f8677123653 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:04.505191 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a866881-5085-49d9-a872-f36caa053b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:04.506134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a866881-5085-49d9-a872-f36caa053b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:04.506134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a866881-5085-49d9-a872-f36caa053b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:04.506480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a866881-5085-49d9-a872-f36caa053b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:04.507033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a866881-5085-49d9-a872-f36caa053b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:04.509208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a866881-5085-49d9-a872-f36caa053b68 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:04.520365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1300/2602] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:37:04.524513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a6b0f-0f8f-4940-8f4a-b90f4adf2ee8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:04.534285 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a6b0f-0f8f-4940-8f4a-b90f4adf2ee8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:04.538844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed7ba1-f3eb-4cb3-8da3-add4e2492160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:04.539443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed7ba1-f3eb-4cb3-8da3-add4e2492160 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:04.539716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed7ba1-f3eb-4cb3-8da3-add4e2492160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:04.539988 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed7ba1-f3eb-4cb3-8da3-add4e2492160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:04.540630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed7ba1-f3eb-4cb3-8da3-add4e2492160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:04.542246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed7ba1-f3eb-4cb3-8da3-add4e2492160 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:04.553161 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1303/2603] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:37:04.557878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a866881-5085-49d9-a872-f36caa053b68 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:04.567926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a866881-5085-49d9-a872-f36caa053b68 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:04.573035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3626bb-425a-46a7-b38c-0c915da60dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:04.573692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3626bb-425a-46a7-b38c-0c915da60dba admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:04.573983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3626bb-425a-46a7-b38c-0c915da60dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:04.574257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3626bb-425a-46a7-b38c-0c915da60dba admin admin] PATH_INFO: `/v3/projects/18a24104020b4495b5532a9a18788220/users/f89dfcc7ba594316825948d126dbafaf/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:04.588473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3626bb-425a-46a7-b38c-0c915da60dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a24104020b4495b5532a9a18788220, user_id=f89dfcc7ba594316825948d126dbafaf, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:04.591130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3626bb-425a-46a7-b38c-0c915da60dba admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:04.702514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1301/2604] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:37:04 2022] PUT /identity/v3/projects/18a24104020b4495b5532a9a18788220/users/f89dfcc7ba594316825948d126dbafaf/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:04.712843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ea09-12d7-4973-99b2-6e58ec908aa3 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:04.713098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ea09-12d7-4973-99b2-6e58ec908aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:04.713376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ea09-12d7-4973-99b2-6e58ec908aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:04.742730 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-a453ea09-12d7-4973-99b2-6e58ec908aa3 None None] MFA Rules not processed for user `f89dfcc7ba594316825948d126dbafaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:04.743862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a453ea09-12d7-4973-99b2-6e58ec908aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:04.809878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1304/2605] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:04.814565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3626bb-425a-46a7-b38c-0c915da60dba admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:04.875255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3626bb-425a-46a7-b38c-0c915da60dba admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:04.879905 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1b83-2344-4bb4-bdc2-63ae13b6f6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:04.880500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1b83-2344-4bb4-bdc2-63ae13b6f6ad admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:04.880780 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1b83-2344-4bb4-bdc2-63ae13b6f6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:04.881055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1b83-2344-4bb4-bdc2-63ae13b6f6ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:04.881721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a1b83-2344-4bb4-bdc2-63ae13b6f6ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:04.883695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a1b83-2344-4bb4-bdc2-63ae13b6f6ad admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:04.968894 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1302/2606] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:37:04 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:04.973109 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ea09-12d7-4973-99b2-6e58ec908aa3 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:04.984776 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ea09-12d7-4973-99b2-6e58ec908aa3 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:05.027439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:05.043046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056ace7-d90e-4c4d-ad83-be1f8fa652d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:05.043201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056ace7-d90e-4c4d-ad83-be1f8fa652d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:05.043434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056ace7-d90e-4c4d-ad83-be1f8fa652d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:05.043738 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056ace7-d90e-4c4d-ad83-be1f8fa652d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:05.044366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056ace7-d90e-4c4d-ad83-be1f8fa652d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:05.046307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056ace7-d90e-4c4d-ad83-be1f8fa652d6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:05.190008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1305/2607] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:37:04 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:05.197227 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1b83-2344-4bb4-bdc2-63ae13b6f6ad admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:05.207842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1b83-2344-4bb4-bdc2-63ae13b6f6ad admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:05.213110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bacf0-a612-496c-b63b-5426e7a96e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:05.213760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bacf0-a612-496c-b63b-5426e7a96e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:05.214049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bacf0-a612-496c-b63b-5426e7a96e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:05.214351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bacf0-a612-496c-b63b-5426e7a96e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:05.215001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bacf0-a612-496c-b63b-5426e7a96e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:05.216640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bacf0-a612-496c-b63b-5426e7a96e29 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:05.228710 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1303/2608] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:37:05.232939 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056ace7-d90e-4c4d-ad83-be1f8fa652d6 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:05.242798 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056ace7-d90e-4c4d-ad83-be1f8fa652d6 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:05.247278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe757-591c-471b-bc82-a70df8df4c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:05.247997 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe757-591c-471b-bc82-a70df8df4c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:05.248194 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe757-591c-471b-bc82-a70df8df4c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:05.248467 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe757-591c-471b-bc82-a70df8df4c74 admin admin] PATH_INFO: `/v3/projects/355e6fe607af4801b5ae3a5dff083eab/users/1f21a64869ce4954a73f016e7f14d7af/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:05.262689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbe757-591c-471b-bc82-a70df8df4c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355e6fe607af4801b5ae3a5dff083eab, user_id=1f21a64869ce4954a73f016e7f14d7af, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:05.265315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbe757-591c-471b-bc82-a70df8df4c74 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:05.377241 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1306/2609] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:37:05 2022] PUT /identity/v3/projects/355e6fe607af4801b5ae3a5dff083eab/users/1f21a64869ce4954a73f016e7f14d7af/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:05.377461 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bacf0-a612-496c-b63b-5426e7a96e29 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:05.381299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bacf0-a612-496c-b63b-5426e7a96e29 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:05.390212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:05.441728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453cb93-7815-49c3-958b-7af17a68f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:05.442347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453cb93-7815-49c3-958b-7af17a68f03f admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:05.442685 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453cb93-7815-49c3-958b-7af17a68f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:05.442915 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453cb93-7815-49c3-958b-7af17a68f03f admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:05.443652 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453cb93-7815-49c3-958b-7af17a68f03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:05.445889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453cb93-7815-49c3-958b-7af17a68f03f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:05.455756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1304/2610] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:37:05.459924 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe757-591c-471b-bc82-a70df8df4c74 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:05.470702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe757-591c-471b-bc82-a70df8df4c74 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:05.475280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe84119-65d9-4914-a3d3-f6051e92612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:05.475928 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe84119-65d9-4914-a3d3-f6051e92612d admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:05.476207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe84119-65d9-4914-a3d3-f6051e92612d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:05.476484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe84119-65d9-4914-a3d3-f6051e92612d admin admin] PATH_INFO: `/v3/projects/355e6fe607af4801b5ae3a5dff083eab/users/1f21a64869ce4954a73f016e7f14d7af/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:05.478688 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe84119-65d9-4914-a3d3-f6051e92612d admin admin] RBAC: Authorizing `identity:create_grant(project_id=355e6fe607af4801b5ae3a5dff083eab, user_id=1f21a64869ce4954a73f016e7f14d7af, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:05.481301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe84119-65d9-4914-a3d3-f6051e92612d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:05.491341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1307/2611] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:37:05 2022] PUT /identity/v3/projects/355e6fe607af4801b5ae3a5dff083eab/users/1f21a64869ce4954a73f016e7f14d7af/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:05.502485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc4bf-568c-4764-870b-f509a3363d16 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:05.502983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc4bf-568c-4764-870b-f509a3363d16 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:05.514847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc4bf-568c-4764-870b-f509a3363d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:05.532553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4a5cc4bf-568c-4764-870b-f509a3363d16 None None] MFA Rules not processed for user `1f21a64869ce4954a73f016e7f14d7af`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:05.533827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4a5cc4bf-568c-4764-870b-f509a3363d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:05.606839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1305/2612] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:05.617635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe84119-65d9-4914-a3d3-f6051e92612d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:05.619369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-cfe84119-65d9-4914-a3d3-f6051e92612d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:05.699884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe84119-65d9-4914-a3d3-f6051e92612d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:05.703612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490acf7-6d68-4f77-aac4-28b11c6a9c47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:05.704219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490acf7-6d68-4f77-aac4-28b11c6a9c47 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:05.704503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490acf7-6d68-4f77-aac4-28b11c6a9c47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:05.704781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490acf7-6d68-4f77-aac4-28b11c6a9c47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:05.762817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490acf7-6d68-4f77-aac4-28b11c6a9c47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:05.764253 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490acf7-6d68-4f77-aac4-28b11c6a9c47 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:05.773151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1308/2613] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:37:11.166567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cc4bf-568c-4764-870b-f509a3363d16 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:11.168153 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4a5cc4bf-568c-4764-870b-f509a3363d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:11.237708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cc4bf-568c-4764-870b-f509a3363d16 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:11.243142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978800f5-dccf-4b7c-bb4e-bfe13e3ccb98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:11.243755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978800f5-dccf-4b7c-bb4e-bfe13e3ccb98 service placement] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:11.244043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978800f5-dccf-4b7c-bb4e-bfe13e3ccb98 service placement] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:11.244315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978800f5-dccf-4b7c-bb4e-bfe13e3ccb98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:11.246124 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-978800f5-dccf-4b7c-bb4e-bfe13e3ccb98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:11.257451 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978800f5-dccf-4b7c-bb4e-bfe13e3ccb98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:11.259120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978800f5-dccf-4b7c-bb4e-bfe13e3ccb98 service placement] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:11.269967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1306/2614] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:12.946409 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a0e0-3a60-4f32-a7af-185c4fb67083 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:12.946910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a0e0-3a60-4f32-a7af-185c4fb67083 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:12.946910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a0e0-3a60-4f32-a7af-185c4fb67083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:12.967874 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-10e9a0e0-3a60-4f32-a7af-185c4fb67083 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:12.969130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-10e9a0e0-3a60-4f32-a7af-185c4fb67083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:12.997041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:13.026198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1309/2615] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 31 19:37:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:13.038600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978800f5-dccf-4b7c-bb4e-bfe13e3ccb98 service placement] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:13.040602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-978800f5-dccf-4b7c-bb4e-bfe13e3ccb98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:13.069633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:13.112958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978800f5-dccf-4b7c-bb4e-bfe13e3ccb98 service placement] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:13.118559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cad73-a7e6-403b-8cc0-b0ce9135da99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:13.119173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cad73-a7e6-403b-8cc0-b0ce9135da99 service swift] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:13.119457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cad73-a7e6-403b-8cc0-b0ce9135da99 service swift] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:13.119733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cad73-a7e6-403b-8cc0-b0ce9135da99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:13.128010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cad73-a7e6-403b-8cc0-b0ce9135da99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:13.129625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cad73-a7e6-403b-8cc0-b0ce9135da99 service swift] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:13.137940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1307/2616] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:37:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:37:14.161848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9a0e0-3a60-4f32-a7af-185c4fb67083 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:14.163358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-10e9a0e0-3a60-4f32-a7af-185c4fb67083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:14.175048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9a0e0-3a60-4f32-a7af-185c4fb67083 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:14.178925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93d5e2-4ebd-4581-81a1-25ced90e3c59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:14.179562 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93d5e2-4ebd-4581-81a1-25ced90e3c59 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:14.179845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93d5e2-4ebd-4581-81a1-25ced90e3c59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:14.180125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93d5e2-4ebd-4581-81a1-25ced90e3c59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:14.189991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93d5e2-4ebd-4581-81a1-25ced90e3c59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:14.191462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93d5e2-4ebd-4581-81a1-25ced90e3c59 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:14.201848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1310/2617] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:21.409397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cad73-a7e6-403b-8cc0-b0ce9135da99 service swift] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:21.471489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cad73-a7e6-403b-8cc0-b0ce9135da99 service swift] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:21.476265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:21.476889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:21.477171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:21.477442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] PATH_INFO: `/v3/users/f89dfcc7ba594316825948d126dbafaf` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:21.478632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89dfcc7ba594316825948d126dbafaf)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:21.480786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:21.821992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89dfcc7ba594316825948d126dbafaf'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:21.913456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89dfcc7ba594316825948d126dbafaf'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:21.914222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89dfcc7ba594316825948d126dbafaf'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:21.927204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89dfcc7ba594316825948d126dbafaf'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:21.927862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89dfcc7ba594316825948d126dbafaf'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:21.940620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1308/2618] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:37:21 2022] DELETE /identity/v3/users/f89dfcc7ba594316825948d126dbafaf => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:21.945190 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f28de-9f74-4e64-897b-addb135e3a24 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:21.947385 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f28de-9f74-4e64-897b-addb135e3a24 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:21.947385 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f28de-9f74-4e64-897b-addb135e3a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:21.964550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5d8f28de-9f74-4e64-897b-addb135e3a24 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:21.965764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5d8f28de-9f74-4e64-897b-addb135e3a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:22.024509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1311/2619] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:22.034480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:22.035890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:22.071834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:22.115590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43246e1e-65a8-47be-9f8c-3b6b68e6c0a0 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:22.119225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d390-2f0c-42fe-aab8-219d8270224b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:22.119833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d390-2f0c-42fe-aab8-219d8270224b service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:22.120111 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d390-2f0c-42fe-aab8-219d8270224b service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:22.120385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d390-2f0c-42fe-aab8-219d8270224b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:22.130638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5d390-2f0c-42fe-aab8-219d8270224b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:22.132049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5d390-2f0c-42fe-aab8-219d8270224b service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:22.141518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1309/2620] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:22.614722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f28de-9f74-4e64-897b-addb135e3a24 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:22.616126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5d8f28de-9f74-4e64-897b-addb135e3a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:22.628296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f28de-9f74-4e64-897b-addb135e3a24 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:22.632989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:22.633760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:22.634118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:22.634442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] PATH_INFO: `/v3/projects/18a24104020b4495b5532a9a18788220` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:22.635564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a24104020b4495b5532a9a18788220)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:22.637444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:22.765755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a24104020b4495b5532a9a18788220', 'request_id': 'req-245e3887-fbe5-4369-b1d3-f75d3e5ed282'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:22.771838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a24104020b4495b5532a9a18788220', 'request_id': 'req-245e3887-fbe5-4369-b1d3-f75d3e5ed282'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:22.845207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a24104020b4495b5532a9a18788220', 'request_id': 'req-245e3887-fbe5-4369-b1d3-f75d3e5ed282'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:22.856629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] The token cache is being invalidate because project 18a24104020b4495b5532a9a18788220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:37:22.856916 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:22.857545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:22.859081 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1312/2621] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:37:22 2022] DELETE /identity/v3/projects/18a24104020b4495b5532a9a18788220 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:22.870721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d390-2f0c-42fe-aab8-219d8270224b service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:22.880712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d390-2f0c-42fe-aab8-219d8270224b service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:22.938724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:22.939365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:22.939653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:22.939927 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] PATH_INFO: `/v3/users/1f21a64869ce4954a73f016e7f14d7af` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:22.941080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f21a64869ce4954a73f016e7f14d7af)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:22.943079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:23.135626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f21a64869ce4954a73f016e7f14d7af'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:23.212775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f21a64869ce4954a73f016e7f14d7af'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:23.213521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f21a64869ce4954a73f016e7f14d7af'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:23.226881 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f21a64869ce4954a73f016e7f14d7af'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:23.227532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-06f2a0bf-4942-4a67-8e01-91438486d9ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f21a64869ce4954a73f016e7f14d7af'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:23.239970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1310/2622] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:37:22 2022] DELETE /identity/v3/users/1f21a64869ce4954a73f016e7f14d7af => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:23.660775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:23.662498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:23.682833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e3887-fbe5-4369-b1d3-f75d3e5ed282 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:23.731557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:23.745229 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:23.745957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:23.746313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:23.746543 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] PATH_INFO: `/v3/projects/355e6fe607af4801b5ae3a5dff083eab` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:23.748219 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=355e6fe607af4801b5ae3a5dff083eab)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:23.750168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:23.897233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355e6fe607af4801b5ae3a5dff083eab', 'request_id': 'req-9936ddef-cd9a-4938-99a4-c0f03bfcf035'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:23.903544 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355e6fe607af4801b5ae3a5dff083eab', 'request_id': 'req-9936ddef-cd9a-4938-99a4-c0f03bfcf035'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:23.999287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355e6fe607af4801b5ae3a5dff083eab', 'request_id': 'req-9936ddef-cd9a-4938-99a4-c0f03bfcf035'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:24.010778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] The token cache is being invalidate because project 355e6fe607af4801b5ae3a5dff083eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:37:24.011065 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:24.011804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9936ddef-cd9a-4938-99a4-c0f03bfcf035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:24.013911 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1313/2623] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:37:23 2022] DELETE /identity/v3/projects/355e6fe607af4801b5ae3a5dff083eab => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:24.020145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013b0cb-9eca-474c-a1d8-02c57f75a523 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:24.020650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013b0cb-9eca-474c-a1d8-02c57f75a523 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:24.020761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013b0cb-9eca-474c-a1d8-02c57f75a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:24.043479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-1013b0cb-9eca-474c-a1d8-02c57f75a523 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:24.045376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1013b0cb-9eca-474c-a1d8-02c57f75a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:24.079201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:24.110005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1311/2624] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:24.118849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbbeb1-f573-4798-b3b3-a56fd330d0bc None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:24.119135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbbeb1-f573-4798-b3b3-a56fd330d0bc None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:24.119410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbbeb1-f573-4798-b3b3-a56fd330d0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:24.264005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-44bbbeb1-f573-4798-b3b3-a56fd330d0bc None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:24.265160 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-44bbbeb1-f573-4798-b3b3-a56fd330d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:24.273642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1314/2625] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:37:24.278160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013b0cb-9eca-474c-a1d8-02c57f75a523 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:24.287873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013b0cb-9eca-474c-a1d8-02c57f75a523 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:24.292356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0ca9c-747d-46ed-95d2-2a1ddb8a9484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:24.292941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0ca9c-747d-46ed-95d2-2a1ddb8a9484 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:24.293230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0ca9c-747d-46ed-95d2-2a1ddb8a9484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:24.293490 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0ca9c-747d-46ed-95d2-2a1ddb8a9484 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:24.294661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0ca9c-747d-46ed-95d2-2a1ddb8a9484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:37:24.294960 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0ca9c-747d-46ed-95d2-2a1ddb8a9484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:24.296531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0ca9c-747d-46ed-95d2-2a1ddb8a9484 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:24.307781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1312/2626] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:37:24.312977 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbbeb1-f573-4798-b3b3-a56fd330d0bc None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:24.322724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbbeb1-f573-4798-b3b3-a56fd330d0bc None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:24.328107 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b764b2-b4e2-41ac-808a-957dc29b6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:24.328727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b764b2-b4e2-41ac-808a-957dc29b6953 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:24.329128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b764b2-b4e2-41ac-808a-957dc29b6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:24.329406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b764b2-b4e2-41ac-808a-957dc29b6953 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:24.330133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b764b2-b4e2-41ac-808a-957dc29b6953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:24.332093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b764b2-b4e2-41ac-808a-957dc29b6953 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:24.457741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1315/2627] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:37:24 2022] POST /identity/v3/projects => generated 359 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:24.461861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0ca9c-747d-46ed-95d2-2a1ddb8a9484 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:24.471989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0ca9c-747d-46ed-95d2-2a1ddb8a9484 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:24.529632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a5a10-5441-4efb-a873-7c7e5179267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:24.530198 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a5a10-5441-4efb-a873-7c7e5179267f admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:24.530483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a5a10-5441-4efb-a873-7c7e5179267f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:24.530763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a5a10-5441-4efb-a873-7c7e5179267f admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:24.531561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a5a10-5441-4efb-a873-7c7e5179267f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:24.533658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a5a10-5441-4efb-a873-7c7e5179267f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:24.650277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1313/2628] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:37:24 2022] POST /identity/v3/users => generated 280 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:37:24.654732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b764b2-b4e2-41ac-808a-957dc29b6953 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:24.666912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b764b2-b4e2-41ac-808a-957dc29b6953 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:24.672836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a3292-5ebd-42ae-8d0a-e3d0de339ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:24.673455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a3292-5ebd-42ae-8d0a-e3d0de339ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:24.673777 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a3292-5ebd-42ae-8d0a-e3d0de339ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:24.674054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a3292-5ebd-42ae-8d0a-e3d0de339ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:24.674831 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a3292-5ebd-42ae-8d0a-e3d0de339ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:24.676571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a3292-5ebd-42ae-8d0a-e3d0de339ecd admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:24.690256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1316/2629] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:37:24.694089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a5a10-5441-4efb-a873-7c7e5179267f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:24.705398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a5a10-5441-4efb-a873-7c7e5179267f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:24.710176 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e35e9-4691-4cce-9038-e55119e0c7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:24.710901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e35e9-4691-4cce-9038-e55119e0c7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:24.711596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e35e9-4691-4cce-9038-e55119e0c7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:24.711596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e35e9-4691-4cce-9038-e55119e0c7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:24.712055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e35e9-4691-4cce-9038-e55119e0c7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:24.713642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e35e9-4691-4cce-9038-e55119e0c7a8 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:24.725110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1314/2630] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:37:24.729563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a3292-5ebd-42ae-8d0a-e3d0de339ecd admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:24.740124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a3292-5ebd-42ae-8d0a-e3d0de339ecd admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:24.744728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303907ec-c015-4307-83e0-415fa8648ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:24.745374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303907ec-c015-4307-83e0-415fa8648ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:24.745656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303907ec-c015-4307-83e0-415fa8648ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:24.745990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303907ec-c015-4307-83e0-415fa8648ac2 admin admin] PATH_INFO: `/v3/projects/0b87f013dd334869920ee4611325a910/users/667c3f30401b450e8590c01749b7c0e0/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:24.760596 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303907ec-c015-4307-83e0-415fa8648ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b87f013dd334869920ee4611325a910, user_id=667c3f30401b450e8590c01749b7c0e0, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:24.763759 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303907ec-c015-4307-83e0-415fa8648ac2 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:24.912609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1317/2631] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:37:24 2022] PUT /identity/v3/projects/0b87f013dd334869920ee4611325a910/users/667c3f30401b450e8590c01749b7c0e0/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:37:24.913100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a32270-289d-4d7e-9381-6839fd797450 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:24.913100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a32270-289d-4d7e-9381-6839fd797450 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:24.913100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a32270-289d-4d7e-9381-6839fd797450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:24.928385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-15a32270-289d-4d7e-9381-6839fd797450 None None] MFA Rules not processed for user `667c3f30401b450e8590c01749b7c0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:24.929786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-15a32270-289d-4d7e-9381-6839fd797450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:24.996525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1315/2632] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:25.031573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303907ec-c015-4307-83e0-415fa8648ac2 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:25.032239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-303907ec-c015-4307-83e0-415fa8648ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:25.087941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303907ec-c015-4307-83e0-415fa8648ac2 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:25.092257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc477d29-be9b-435e-aa80-76a3ce5bf452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:25.092855 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc477d29-be9b-435e-aa80-76a3ce5bf452 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:25.093133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc477d29-be9b-435e-aa80-76a3ce5bf452 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:25.093404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc477d29-be9b-435e-aa80-76a3ce5bf452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:25.101630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc477d29-be9b-435e-aa80-76a3ce5bf452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:25.103077 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc477d29-be9b-435e-aa80-76a3ce5bf452 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:25.111960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1318/2633] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:25.127550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a32270-289d-4d7e-9381-6839fd797450 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:25.160729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:25.191667 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a32270-289d-4d7e-9381-6839fd797450 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:25.196274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:25.196903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:25.197192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:25.197473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] PATH_INFO: `/v3/users/667c3f30401b450e8590c01749b7c0e0` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:25.198639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667c3f30401b450e8590c01749b7c0e0)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:25.200677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:25.469784 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667c3f30401b450e8590c01749b7c0e0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:25.572717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667c3f30401b450e8590c01749b7c0e0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:25.573331 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667c3f30401b450e8590c01749b7c0e0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:25.585821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667c3f30401b450e8590c01749b7c0e0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:25.586455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667c3f30401b450e8590c01749b7c0e0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:25.604097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1316/2634] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:37:25 2022] DELETE /identity/v3/users/667c3f30401b450e8590c01749b7c0e0 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:25.609191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce199e87-7b03-48ec-9195-10e9d3474839 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:25.609474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce199e87-7b03-48ec-9195-10e9d3474839 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:25.609785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce199e87-7b03-48ec-9195-10e9d3474839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:25.629290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ce199e87-7b03-48ec-9195-10e9d3474839 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:25.630588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ce199e87-7b03-48ec-9195-10e9d3474839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:25.639901 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:25.688410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1319/2635] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:25.698330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:25.701755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:25.761358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd6852-d7a4-47aa-9715-8bae2fd53498 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:25.765000 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065f432-58fb-42d6-885a-122771622b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:25.765659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065f432-58fb-42d6-885a-122771622b93 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:25.766009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065f432-58fb-42d6-885a-122771622b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:25.766286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065f432-58fb-42d6-885a-122771622b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:25.775362 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065f432-58fb-42d6-885a-122771622b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:25.776835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065f432-58fb-42d6-885a-122771622b93 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:25.786330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1317/2636] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:37:26.272225 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce199e87-7b03-48ec-9195-10e9d3474839 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:26.273762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ce199e87-7b03-48ec-9195-10e9d3474839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:26.286490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce199e87-7b03-48ec-9195-10e9d3474839 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:26.291210 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:26.291852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:26.292154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:26.292452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] PATH_INFO: `/v3/projects/0b87f013dd334869920ee4611325a910` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:26.293588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b87f013dd334869920ee4611325a910)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:26.295530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:26.414133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b87f013dd334869920ee4611325a910', 'request_id': 'req-fe46b26e-4a75-48f9-a245-87352d4318ab'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:26.420207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b87f013dd334869920ee4611325a910', 'request_id': 'req-fe46b26e-4a75-48f9-a245-87352d4318ab'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:26.498847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b87f013dd334869920ee4611325a910', 'request_id': 'req-fe46b26e-4a75-48f9-a245-87352d4318ab'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:26.509912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] The token cache is being invalidate because project 0b87f013dd334869920ee4611325a910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:37:26.510214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:26.510863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:26.512347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1320/2637] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:37:26 2022] DELETE /identity/v3/projects/0b87f013dd334869920ee4611325a910 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:35.781996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=66,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:36.506724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:51.898467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065f432-58fb-42d6-885a-122771622b93 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:51.907108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065f432-58fb-42d6-885a-122771622b93 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:51.956027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad399879-3d15-4970-bd00-f84925f559fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:51.956637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad399879-3d15-4970-bd00-f84925f559fa service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:51.956920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad399879-3d15-4970-bd00-f84925f559fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:51.957195 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad399879-3d15-4970-bd00-f84925f559fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:51.958953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ad399879-3d15-4970-bd00-f84925f559fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:52.020787 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad399879-3d15-4970-bd00-f84925f559fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:52.022258 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad399879-3d15-4970-bd00-f84925f559fa service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:52.031936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1318/2638] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:37:55.765198 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:55.766751 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:55.781312 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46b26e-4a75-48f9-a245-87352d4318ab admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:55.785907 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:55.786540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:55.786821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:55.787124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] PATH_INFO: `/v3/users/27d710f7757e427fbf3921ab488b0ed1` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:55.788245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d710f7757e427fbf3921ab488b0ed1)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:55.790180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:56.015601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d710f7757e427fbf3921ab488b0ed1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:56.016257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d710f7757e427fbf3921ab488b0ed1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:56.016851 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d710f7757e427fbf3921ab488b0ed1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:56.075766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d710f7757e427fbf3921ab488b0ed1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:56.088377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-1e2d5204-235d-40f6-8119-f87ebb1453a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d710f7757e427fbf3921ab488b0ed1'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:56.100453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1321/2639] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:37:55 2022] DELETE /identity/v3/users/27d710f7757e427fbf3921ab488b0ed1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:56.408982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad399879-3d15-4970-bd00-f84925f559fa service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:56.421194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad399879-3d15-4970-bd00-f84925f559fa service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:56.484479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:56.485148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:56.485434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:56.485745 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] PATH_INFO: `/v3/projects/27e49665175245a8b2297ad078ab76ba` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:56.486909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e49665175245a8b2297ad078ab76ba)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:56.488833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:56.661379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e49665175245a8b2297ad078ab76ba', 'request_id': 'req-a50d4c52-ad07-47d1-b943-e5474de68d11'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:56.663647 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:56.668646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e49665175245a8b2297ad078ab76ba', 'request_id': 'req-a50d4c52-ad07-47d1-b943-e5474de68d11'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:56.825810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e49665175245a8b2297ad078ab76ba', 'request_id': 'req-a50d4c52-ad07-47d1-b943-e5474de68d11'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:56.837128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] The token cache is being invalidate because project 27e49665175245a8b2297ad078ab76ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:37:56.837457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:56.838088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-a50d4c52-ad07-47d1-b943-e5474de68d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:37:56.839612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1319/2640] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:37:56 2022] DELETE /identity/v3/projects/27e49665175245a8b2297ad078ab76ba => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:56.845066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04d752-da5b-43d0-9535-213ecdefda4c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:56.845570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04d752-da5b-43d0-9535-213ecdefda4c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:56.845703 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04d752-da5b-43d0-9535-213ecdefda4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:56.866872 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5f04d752-da5b-43d0-9535-213ecdefda4c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:56.869782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5f04d752-da5b-43d0-9535-213ecdefda4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:56.929605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1322/2641] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:56.937613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ce34-0bcb-4e56-a0c4-bb29d74f9676 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:56.943599 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ce34-0bcb-4e56-a0c4-bb29d74f9676 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:56.943599 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4ce34-0bcb-4e56-a0c4-bb29d74f9676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:56.959285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-83e4ce34-0bcb-4e56-a0c4-bb29d74f9676 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:56.960638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-83e4ce34-0bcb-4e56-a0c4-bb29d74f9676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:56.969133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1320/2642] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:37:56.973626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04d752-da5b-43d0-9535-213ecdefda4c None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:56.984825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04d752-da5b-43d0-9535-213ecdefda4c None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:56.990230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1324c-2feb-42b0-b67c-766f095a3949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:56.990859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1324c-2feb-42b0-b67c-766f095a3949 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:56.991139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1324c-2feb-42b0-b67c-766f095a3949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:56.991412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1324c-2feb-42b0-b67c-766f095a3949 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:56.992073 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1324c-2feb-42b0-b67c-766f095a3949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:37:56.992374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1324c-2feb-42b0-b67c-766f095a3949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:56.994037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1324c-2feb-42b0-b67c-766f095a3949 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:57.007473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1323/2643] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:37:57.012042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4ce34-0bcb-4e56-a0c4-bb29d74f9676 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:57.022357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4ce34-0bcb-4e56-a0c4-bb29d74f9676 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:57.027796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aab270-e410-4eb4-8913-940db38071f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:57.028430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aab270-e410-4eb4-8913-940db38071f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:57.028717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aab270-e410-4eb4-8913-940db38071f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:57.028996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aab270-e410-4eb4-8913-940db38071f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:57.030344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aab270-e410-4eb4-8913-940db38071f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:57.032475 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aab270-e410-4eb4-8913-940db38071f9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:57.175833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1321/2644] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:37:57 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:57.181601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1324c-2feb-42b0-b67c-766f095a3949 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:57.191748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1324c-2feb-42b0-b67c-766f095a3949 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:57.249200 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a52f6e-faea-4699-9d90-21bbc9731f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:57.249844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a52f6e-faea-4699-9d90-21bbc9731f52 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:57.250120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a52f6e-faea-4699-9d90-21bbc9731f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:57.250390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a52f6e-faea-4699-9d90-21bbc9731f52 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:57.251020 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a52f6e-faea-4699-9d90-21bbc9731f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:57.252920 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a52f6e-faea-4699-9d90-21bbc9731f52 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:57.261300 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:57.362768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1324/2645] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:37:57 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:37:57.366867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aab270-e410-4eb4-8913-940db38071f9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:57.377974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aab270-e410-4eb4-8913-940db38071f9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:57.382642 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452e9e0-65c4-4580-99b9-d200e486867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:57.383275 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e9e0-65c4-4580-99b9-d200e486867f admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:57.383559 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e9e0-65c4-4580-99b9-d200e486867f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:57.383836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e9e0-65c4-4580-99b9-d200e486867f admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:57.384486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452e9e0-65c4-4580-99b9-d200e486867f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:57.386134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452e9e0-65c4-4580-99b9-d200e486867f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:57.396597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1322/2646] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:37:57.400589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a52f6e-faea-4699-9d90-21bbc9731f52 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:57.411995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a52f6e-faea-4699-9d90-21bbc9731f52 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:57.416598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4744719-acf1-4990-834d-dac3f3187195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:57.417193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4744719-acf1-4990-834d-dac3f3187195 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:57.417475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4744719-acf1-4990-834d-dac3f3187195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:57.417787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4744719-acf1-4990-834d-dac3f3187195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:57.418436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4744719-acf1-4990-834d-dac3f3187195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:57.420009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4744719-acf1-4990-834d-dac3f3187195 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:57.431018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1325/2647] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:37:57.435231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452e9e0-65c4-4580-99b9-d200e486867f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:57.445128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452e9e0-65c4-4580-99b9-d200e486867f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:57.449575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2d37d-f5ce-489f-8544-3a834d4570ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:57.450245 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2d37d-f5ce-489f-8544-3a834d4570ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:57.450530 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2d37d-f5ce-489f-8544-3a834d4570ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:57.450807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2d37d-f5ce-489f-8544-3a834d4570ea admin admin] PATH_INFO: `/v3/projects/78313bf556db4dd9b546889fc668228e/users/827f9448c84b4a74ac4c64eb3cd57ad7/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:57.465568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2d37d-f5ce-489f-8544-3a834d4570ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=78313bf556db4dd9b546889fc668228e, user_id=827f9448c84b4a74ac4c64eb3cd57ad7, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:57.468729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2d37d-f5ce-489f-8544-3a834d4570ea admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:57.647503 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1323/2648] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:37:57 2022] PUT /identity/v3/projects/78313bf556db4dd9b546889fc668228e/users/827f9448c84b4a74ac4c64eb3cd57ad7/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:37:57.652736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d682c54-f33c-4174-9331-d8fbaf4c724a None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:57.653013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d682c54-f33c-4174-9331-d8fbaf4c724a None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:57.653286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d682c54-f33c-4174-9331-d8fbaf4c724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:57.673923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-6d682c54-f33c-4174-9331-d8fbaf4c724a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:37:57.675126 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6d682c54-f33c-4174-9331-d8fbaf4c724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:57.734602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1326/2649] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:37:57.744550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2d37d-f5ce-489f-8544-3a834d4570ea admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:37:57.746301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b4f2d37d-f5ce-489f-8544-3a834d4570ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:37:57.807258 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2d37d-f5ce-489f-8544-3a834d4570ea admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:37:57.820582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc82ca8-c6df-4885-86e5-f648cd0514cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:37:57.821352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc82ca8-c6df-4885-86e5-f648cd0514cc service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:37:57.821772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc82ca8-c6df-4885-86e5-f648cd0514cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:37:57.822158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc82ca8-c6df-4885-86e5-f648cd0514cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:37:57.835534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc82ca8-c6df-4885-86e5-f648cd0514cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:37:57.837109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc82ca8-c6df-4885-86e5-f648cd0514cc service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:37:57.848712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1324/2650] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:03.695583 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b285-7721-4290-8aac-cb1cef67b0fa None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:03.696114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b285-7721-4290-8aac-cb1cef67b0fa None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:03.696114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6b285-7721-4290-8aac-cb1cef67b0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:03.733341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-2ce6b285-7721-4290-8aac-cb1cef67b0fa None None] MFA Rules not processed for user `827f9448c84b4a74ac4c64eb3cd57ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:03.734623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-2ce6b285-7721-4290-8aac-cb1cef67b0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:03.802797 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1327/2651] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:03.819626 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc82ca8-c6df-4885-86e5-f648cd0514cc service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:03.821297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-0bc82ca8-c6df-4885-86e5-f648cd0514cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:03.899880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc82ca8-c6df-4885-86e5-f648cd0514cc service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:03.905477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a900eb-907d-405d-8acb-be8eb0a5cbd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:03.906120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a900eb-907d-405d-8acb-be8eb0a5cbd5 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:03.906406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a900eb-907d-405d-8acb-be8eb0a5cbd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:03.906684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a900eb-907d-405d-8acb-be8eb0a5cbd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:03.914409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a900eb-907d-405d-8acb-be8eb0a5cbd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:03.915970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a900eb-907d-405d-8acb-be8eb0a5cbd5 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:03.925305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1325/2652] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:08.052192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44128f-a6e0-4573-8817-c8bb76c95782 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:08.052736 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44128f-a6e0-4573-8817-c8bb76c95782 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:08.052850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44128f-a6e0-4573-8817-c8bb76c95782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:08.073099 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4d44128f-a6e0-4573-8817-c8bb76c95782 None None] MFA Rules not processed for user `827f9448c84b4a74ac4c64eb3cd57ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:08.074342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4d44128f-a6e0-4573-8817-c8bb76c95782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:08.081967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1328/2653] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:13.921402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:18.067590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:22.039801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a900eb-907d-405d-8acb-be8eb0a5cbd5 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:22.041233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-38a900eb-907d-405d-8acb-be8eb0a5cbd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:22.054572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a900eb-907d-405d-8acb-be8eb0a5cbd5 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:22.058191 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c04353-9155-4b02-9666-d2fbd042b21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:22.060637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c04353-9155-4b02-9666-d2fbd042b21b service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:22.060637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c04353-9155-4b02-9666-d2fbd042b21b service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:22.060637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c04353-9155-4b02-9666-d2fbd042b21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:22.061085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d2c04353-9155-4b02-9666-d2fbd042b21b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:22.075880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c04353-9155-4b02-9666-d2fbd042b21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:22.077386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c04353-9155-4b02-9666-d2fbd042b21b service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:22.090039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1326/2654] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:23.257609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44128f-a6e0-4573-8817-c8bb76c95782 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:23.267708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44128f-a6e0-4573-8817-c8bb76c95782 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:23.272366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ff588-18a2-49a6-add3-67a384bbd3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:23.272816 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c04353-9155-4b02-9666-d2fbd042b21b service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:23.273402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ff588-18a2-49a6-add3-67a384bbd3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:23.273402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ff588-18a2-49a6-add3-67a384bbd3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:23.273594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ff588-18a2-49a6-add3-67a384bbd3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:23.276306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b25ff588-18a2-49a6-add3-67a384bbd3c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:23.281759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c04353-9155-4b02-9666-d2fbd042b21b service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:23.285553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15d36c-e847-4752-bd77-5e755fd84585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:23.286089 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15d36c-e847-4752-bd77-5e755fd84585 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:23.286374 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15d36c-e847-4752-bd77-5e755fd84585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:23.286649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15d36c-e847-4752-bd77-5e755fd84585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:23.288431 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-bd15d36c-e847-4752-bd77-5e755fd84585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:23.291783 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ff588-18a2-49a6-add3-67a384bbd3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:23.291926 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ff588-18a2-49a6-add3-67a384bbd3c1 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:23.303908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1329/2655] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:23.309909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15d36c-e847-4752-bd77-5e755fd84585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:23.313144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15d36c-e847-4752-bd77-5e755fd84585 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:23.327173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1327/2656] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:27.440519 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ff588-18a2-49a6-add3-67a384bbd3c1 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:27.442015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b25ff588-18a2-49a6-add3-67a384bbd3c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:27.460169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ff588-18a2-49a6-add3-67a384bbd3c1 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:27.460169 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:27.461083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:27.461083 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:27.461279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] PATH_INFO: `/v3/users/9b0a09141e3748359837fed83f0eff98` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:27.475104 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0a09141e3748359837fed83f0eff98)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:27.477048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:27.696474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0a09141e3748359837fed83f0eff98'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:27.697040 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0a09141e3748359837fed83f0eff98'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:27.697635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0a09141e3748359837fed83f0eff98'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:27.784743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0a09141e3748359837fed83f0eff98'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:27.797522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce720308-ba61-4fe2-b8cc-2db6065c50d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0a09141e3748359837fed83f0eff98'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:27.809578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1330/2657] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:27 2022] DELETE /identity/v3/users/9b0a09141e3748359837fed83f0eff98 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:28.063297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15d36c-e847-4752-bd77-5e755fd84585 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:28.076267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15d36c-e847-4752-bd77-5e755fd84585 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:28.139052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:28.140188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.140691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.141685 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] PATH_INFO: `/v3/projects/b8797d7171d4455f8bf8392c24003bf2` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.156394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8797d7171d4455f8bf8392c24003bf2)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:28.159200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:28.266950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8797d7171d4455f8bf8392c24003bf2', 'request_id': 'req-318e2329-c6be-46e4-9c07-8aed7d7c7e62'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:28.274205 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8797d7171d4455f8bf8392c24003bf2', 'request_id': 'req-318e2329-c6be-46e4-9c07-8aed7d7c7e62'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:28.348011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8797d7171d4455f8bf8392c24003bf2', 'request_id': 'req-318e2329-c6be-46e4-9c07-8aed7d7c7e62'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:28.361237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] The token cache is being invalidate because project b8797d7171d4455f8bf8392c24003bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:28.361531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:28.362253 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-318e2329-c6be-46e4-9c07-8aed7d7c7e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:28.363791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1328/2658] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:28 2022] DELETE /identity/v3/projects/b8797d7171d4455f8bf8392c24003bf2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:28.370716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0dde0-d7ad-41d1-8333-dde0c44cc093 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.371002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0dde0-d7ad-41d1-8333-dde0c44cc093 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.371278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0dde0-d7ad-41d1-8333-dde0c44cc093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.392817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-26a0dde0-d7ad-41d1-8333-dde0c44cc093 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:28.394800 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-26a0dde0-d7ad-41d1-8333-dde0c44cc093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:28.468258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1331/2659] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:28.477464 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d13dbb-5c1f-468a-8f8c-be3772290cfc None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.477793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d13dbb-5c1f-468a-8f8c-be3772290cfc None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.478079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d13dbb-5c1f-468a-8f8c-be3772290cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.501423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b4d13dbb-5c1f-468a-8f8c-be3772290cfc None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:28.503167 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b4d13dbb-5c1f-468a-8f8c-be3772290cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:28.511376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1329/2660] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:28.515964 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0dde0-d7ad-41d1-8333-dde0c44cc093 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:28.526486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0dde0-d7ad-41d1-8333-dde0c44cc093 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:28.531159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da70c-ef27-4bf0-a112-dbe6cc677a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:28.532340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da70c-ef27-4bf0-a112-dbe6cc677a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.532548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da70c-ef27-4bf0-a112-dbe6cc677a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.532817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da70c-ef27-4bf0-a112-dbe6cc677a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.533481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da70c-ef27-4bf0-a112-dbe6cc677a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:38:28.533837 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da70c-ef27-4bf0-a112-dbe6cc677a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:28.535735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63da70c-ef27-4bf0-a112-dbe6cc677a6f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:28.548391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1332/2661] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:38:28.553181 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d13dbb-5c1f-468a-8f8c-be3772290cfc None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:28.562520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d13dbb-5c1f-468a-8f8c-be3772290cfc None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:28.567425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891a34e-0728-49a2-ae71-4d1726e9917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:28.568055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891a34e-0728-49a2-ae71-4d1726e9917e admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.568360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891a34e-0728-49a2-ae71-4d1726e9917e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.568632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891a34e-0728-49a2-ae71-4d1726e9917e admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.569305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891a34e-0728-49a2-ae71-4d1726e9917e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:28.571399 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891a34e-0728-49a2-ae71-4d1726e9917e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:28.686808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1330/2662] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:28 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:28.691712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da70c-ef27-4bf0-a112-dbe6cc677a6f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:28.702059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da70c-ef27-4bf0-a112-dbe6cc677a6f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:28.738564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:28.762954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da013319-4dd8-4db4-aac0-ace9e8344602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:28.763595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da013319-4dd8-4db4-aac0-ace9e8344602 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.763873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da013319-4dd8-4db4-aac0-ace9e8344602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.764146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da013319-4dd8-4db4-aac0-ace9e8344602 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.764845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da013319-4dd8-4db4-aac0-ace9e8344602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:28.766842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da013319-4dd8-4db4-aac0-ace9e8344602 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:28.851673 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1333/2663] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:28 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:28.856056 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891a34e-0728-49a2-ae71-4d1726e9917e admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:28.866855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891a34e-0728-49a2-ae71-4d1726e9917e admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:28.871613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9f4a0-3416-41cc-bc73-2171899ae05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:28.872251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9f4a0-3416-41cc-bc73-2171899ae05a admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.872531 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9f4a0-3416-41cc-bc73-2171899ae05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.872807 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9f4a0-3416-41cc-bc73-2171899ae05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.873450 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9f4a0-3416-41cc-bc73-2171899ae05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:28.875107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9f4a0-3416-41cc-bc73-2171899ae05a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:28.886317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1331/2664] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:28.895090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da013319-4dd8-4db4-aac0-ace9e8344602 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:28.904994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da013319-4dd8-4db4-aac0-ace9e8344602 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:28.910373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca8efc-f72e-4876-8dd5-d29929ee1083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:28.910990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca8efc-f72e-4876-8dd5-d29929ee1083 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.911275 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca8efc-f72e-4876-8dd5-d29929ee1083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.911547 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca8efc-f72e-4876-8dd5-d29929ee1083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.912221 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca8efc-f72e-4876-8dd5-d29929ee1083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:28.913835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca8efc-f72e-4876-8dd5-d29929ee1083 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:28.924181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1334/2665] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:28.929449 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9f4a0-3416-41cc-bc73-2171899ae05a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:28.939929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9f4a0-3416-41cc-bc73-2171899ae05a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:28.944676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2d66-46cd-4c19-a827-0542cd5caa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:28.945323 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2d66-46cd-4c19-a827-0542cd5caa20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:28.945614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2d66-46cd-4c19-a827-0542cd5caa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:28.945920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2d66-46cd-4c19-a827-0542cd5caa20 admin admin] PATH_INFO: `/v3/projects/bfe1ff42d9ec45a599be3de759945432/users/a66f2d36c136443db2bf8c107a8c25f3/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:28.948107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:28.961376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2d66-46cd-4c19-a827-0542cd5caa20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe1ff42d9ec45a599be3de759945432, user_id=a66f2d36c136443db2bf8c107a8c25f3, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:28.964179 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2d66-46cd-4c19-a827-0542cd5caa20 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.039674 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1332/2666] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:28 2022] PUT /identity/v3/projects/bfe1ff42d9ec45a599be3de759945432/users/a66f2d36c136443db2bf8c107a8c25f3/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:29.050477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802840-b76b-428d-b50d-1d0b55fbfb26 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.050758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802840-b76b-428d-b50d-1d0b55fbfb26 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.051030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802840-b76b-428d-b50d-1d0b55fbfb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.078061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-a2802840-b76b-428d-b50d-1d0b55fbfb26 None None] MFA Rules not processed for user `a66f2d36c136443db2bf8c107a8c25f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:29.079700 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a2802840-b76b-428d-b50d-1d0b55fbfb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:29.146636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1335/2667] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:29.151143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2d66-46cd-4c19-a827-0542cd5caa20 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.213102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2d66-46cd-4c19-a827-0542cd5caa20 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.217698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ee74e-f29c-48b7-9655-1600635c6676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.218307 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee74e-f29c-48b7-9655-1600635c6676 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.218589 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee74e-f29c-48b7-9655-1600635c6676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.218867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee74e-f29c-48b7-9655-1600635c6676 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.219499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ee74e-f29c-48b7-9655-1600635c6676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.221432 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ee74e-f29c-48b7-9655-1600635c6676 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.314518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1333/2668] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:29 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:29.318622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2802840-b76b-428d-b50d-1d0b55fbfb26 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.329942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2802840-b76b-428d-b50d-1d0b55fbfb26 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.385096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5bf98-4a86-43b4-bd77-469942fd10a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.385710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5bf98-4a86-43b4-bd77-469942fd10a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.385991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5bf98-4a86-43b4-bd77-469942fd10a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.386258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5bf98-4a86-43b4-bd77-469942fd10a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.386875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5bf98-4a86-43b4-bd77-469942fd10a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.388765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5bf98-4a86-43b4-bd77-469942fd10a9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.536795 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1336/2669] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:29 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:38:29.541343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ee74e-f29c-48b7-9655-1600635c6676 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.551920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ee74e-f29c-48b7-9655-1600635c6676 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.556470 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bccdd-9b16-4a56-923c-b5652dbfdeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.557070 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bccdd-9b16-4a56-923c-b5652dbfdeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.557352 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bccdd-9b16-4a56-923c-b5652dbfdeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.557621 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bccdd-9b16-4a56-923c-b5652dbfdeb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.558304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bccdd-9b16-4a56-923c-b5652dbfdeb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.559886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bccdd-9b16-4a56-923c-b5652dbfdeb9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.571661 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1334/2670] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:29.576335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5bf98-4a86-43b4-bd77-469942fd10a9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.587434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5bf98-4a86-43b4-bd77-469942fd10a9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.592172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bb20f-fca5-422d-959f-3aaac22397ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.592824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb20f-fca5-422d-959f-3aaac22397ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.593098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb20f-fca5-422d-959f-3aaac22397ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.593367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb20f-fca5-422d-959f-3aaac22397ab admin admin] PATH_INFO: `/v3/projects/f0cb706474af44d399e6f10641b42473/users/79be4e41665343358f8dfbf6bb2512ca/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.608880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bb20f-fca5-422d-959f-3aaac22397ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cb706474af44d399e6f10641b42473, user_id=79be4e41665343358f8dfbf6bb2512ca, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.612045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bb20f-fca5-422d-959f-3aaac22397ab admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.691747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1337/2671] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:29 2022] PUT /identity/v3/projects/f0cb706474af44d399e6f10641b42473/users/79be4e41665343358f8dfbf6bb2512ca/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:29.695961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bccdd-9b16-4a56-923c-b5652dbfdeb9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.706055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bccdd-9b16-4a56-923c-b5652dbfdeb9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.762538 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46007389-e5b2-43a0-a5cb-401817d54616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.763148 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46007389-e5b2-43a0-a5cb-401817d54616 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.763428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46007389-e5b2-43a0-a5cb-401817d54616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.763702 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46007389-e5b2-43a0-a5cb-401817d54616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.764386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46007389-e5b2-43a0-a5cb-401817d54616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.766132 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46007389-e5b2-43a0-a5cb-401817d54616 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.775861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1335/2672] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:38:29.780042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bb20f-fca5-422d-959f-3aaac22397ab admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.790276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bb20f-fca5-422d-959f-3aaac22397ab admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:29.794971 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74705185-e7f2-4db5-9c39-1126543dc498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:29.795781 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74705185-e7f2-4db5-9c39-1126543dc498 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.796057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74705185-e7f2-4db5-9c39-1126543dc498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.796356 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74705185-e7f2-4db5-9c39-1126543dc498 admin admin] PATH_INFO: `/v3/projects/f0cb706474af44d399e6f10641b42473/users/79be4e41665343358f8dfbf6bb2512ca/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.798810 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74705185-e7f2-4db5-9c39-1126543dc498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cb706474af44d399e6f10641b42473, user_id=79be4e41665343358f8dfbf6bb2512ca, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:29.801400 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74705185-e7f2-4db5-9c39-1126543dc498 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:29.804716 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:29.812345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1338/2673] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:29 2022] PUT /identity/v3/projects/f0cb706474af44d399e6f10641b42473/users/79be4e41665343358f8dfbf6bb2512ca/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:29.830329 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ac65-2595-4368-b8db-ef6eb1e13da1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:29.830620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ac65-2595-4368-b8db-ef6eb1e13da1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:29.830898 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ac65-2595-4368-b8db-ef6eb1e13da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:29.858555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-df20ac65-2595-4368-b8db-ef6eb1e13da1 None None] MFA Rules not processed for user `79be4e41665343358f8dfbf6bb2512ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:29.859679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-df20ac65-2595-4368-b8db-ef6eb1e13da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:29.901304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:29.927159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1336/2674] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:29.939031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74705185-e7f2-4db5-9c39-1126543dc498 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:29.940718 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-74705185-e7f2-4db5-9c39-1126543dc498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:29.997446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74705185-e7f2-4db5-9c39-1126543dc498 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:30.001015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93992661-ff16-4bfc-b661-77c1aa4cbfa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:30.001609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992661-ff16-4bfc-b661-77c1aa4cbfa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:30.001913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992661-ff16-4bfc-b661-77c1aa4cbfa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:30.002183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992661-ff16-4bfc-b661-77c1aa4cbfa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:30.011272 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992661-ff16-4bfc-b661-77c1aa4cbfa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:30.012679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992661-ff16-4bfc-b661-77c1aa4cbfa2 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:30.021816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1339/2675] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:38:30.242952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ac65-2595-4368-b8db-ef6eb1e13da1 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:30.253759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ac65-2595-4368-b8db-ef6eb1e13da1 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:30.257218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e75c2-2bd6-4d17-8f49-75b8e8084a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:30.257876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e75c2-2bd6-4d17-8f49-75b8e8084a4d service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:30.258159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e75c2-2bd6-4d17-8f49-75b8e8084a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:30.258433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e75c2-2bd6-4d17-8f49-75b8e8084a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:30.317381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e75c2-2bd6-4d17-8f49-75b8e8084a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:30.318872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e75c2-2bd6-4d17-8f49-75b8e8084a4d service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:30.329526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1337/2676] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:40.017835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=28 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:40.324192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=38 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:41.651391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93992661-ff16-4bfc-b661-77c1aa4cbfa2 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:41.712239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93992661-ff16-4bfc-b661-77c1aa4cbfa2 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:41.716903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:41.717552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:41.717863 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:41.718138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] PATH_INFO: `/v3/users/a66f2d36c136443db2bf8c107a8c25f3` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:41.719261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66f2d36c136443db2bf8c107a8c25f3)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:41.721158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:41.964746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66f2d36c136443db2bf8c107a8c25f3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:41.965397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66f2d36c136443db2bf8c107a8c25f3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:41.966014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66f2d36c136443db2bf8c107a8c25f3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:42.084777 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66f2d36c136443db2bf8c107a8c25f3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:42.097260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66f2d36c136443db2bf8c107a8c25f3'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:42.109624 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1340/2677] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:41 2022] DELETE /identity/v3/users/a66f2d36c136443db2bf8c107a8c25f3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:42.114500 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6739d70-20cc-4d95-b42e-587a5880af14 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:42.114999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6739d70-20cc-4d95-b42e-587a5880af14 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:42.115154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6739d70-20cc-4d95-b42e-587a5880af14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:42.134954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b6739d70-20cc-4d95-b42e-587a5880af14 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:42.136184 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b6739d70-20cc-4d95-b42e-587a5880af14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:42.196194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1338/2678] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:38:42.206292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:42.208317 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:42.264535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc196c-e896-4deb-960c-d56745044462 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:42.267978 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84321-7c8a-4864-b842-461cf6a0494b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:42.268572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84321-7c8a-4864-b842-461cf6a0494b service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:42.268847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84321-7c8a-4864-b842-461cf6a0494b service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:42.269118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84321-7c8a-4864-b842-461cf6a0494b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:42.277902 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee84321-7c8a-4864-b842-461cf6a0494b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:42.279314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee84321-7c8a-4864-b842-461cf6a0494b service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:42.288472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1341/2679] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:42.867054 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6739d70-20cc-4d95-b42e-587a5880af14 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:42.868495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b6739d70-20cc-4d95-b42e-587a5880af14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:42.880697 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6739d70-20cc-4d95-b42e-587a5880af14 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:42.885328 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:42.886013 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:42.886298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:42.886576 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] PATH_INFO: `/v3/projects/bfe1ff42d9ec45a599be3de759945432` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:42.887714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe1ff42d9ec45a599be3de759945432)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:42.889867 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:43.056595 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe1ff42d9ec45a599be3de759945432', 'request_id': 'req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:43.062865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe1ff42d9ec45a599be3de759945432', 'request_id': 'req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:43.221853 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe1ff42d9ec45a599be3de759945432', 'request_id': 'req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:43.233912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] The token cache is being invalidate because project bfe1ff42d9ec45a599be3de759945432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:43.234212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:43.234847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:43.236406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1339/2680] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:42 2022] DELETE /identity/v3/projects/bfe1ff42d9ec45a599be3de759945432 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:43.240439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84321-7c8a-4864-b842-461cf6a0494b service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:43.250216 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84321-7c8a-4864-b842-461cf6a0494b service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:43.268774 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:43.307748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:43.308387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:43.308661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:43.308936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] PATH_INFO: `/v3/users/79be4e41665343358f8dfbf6bb2512ca` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:43.310114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79be4e41665343358f8dfbf6bb2512ca)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:43.312028 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:43.607154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79be4e41665343358f8dfbf6bb2512ca'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:43.607744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79be4e41665343358f8dfbf6bb2512ca'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:43.608368 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79be4e41665343358f8dfbf6bb2512ca'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:43.701689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79be4e41665343358f8dfbf6bb2512ca'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:43.718182 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-57724f47-5579-4d2c-a135-e0949570a489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79be4e41665343358f8dfbf6bb2512ca'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:43.730733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1342/2681] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:43 2022] DELETE /identity/v3/users/79be4e41665343358f8dfbf6bb2512ca => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:44.215631 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:44.222808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:44.230060 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062297c-9ea1-4bb4-995b-f9ebe12bcdca admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:44.293635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:44.294304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:44.294602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:44.294899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] PATH_INFO: `/v3/projects/f0cb706474af44d399e6f10641b42473` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:44.296042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0cb706474af44d399e6f10641b42473)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:44.298139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:44.440495 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:44.458204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0cb706474af44d399e6f10641b42473', 'request_id': 'req-c552fe6a-8993-4e58-89a1-989f5aad30b4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:44.464467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0cb706474af44d399e6f10641b42473', 'request_id': 'req-c552fe6a-8993-4e58-89a1-989f5aad30b4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:44.553591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0cb706474af44d399e6f10641b42473', 'request_id': 'req-c552fe6a-8993-4e58-89a1-989f5aad30b4'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:44.564654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] The token cache is being invalidate because project f0cb706474af44d399e6f10641b42473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:44.564940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:44.565571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c552fe6a-8993-4e58-89a1-989f5aad30b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:44.567706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1340/2682] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:44 2022] DELETE /identity/v3/projects/f0cb706474af44d399e6f10641b42473 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:44.572569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46eff-1719-42eb-92ea-107c21eb512c None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:44.573078 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46eff-1719-42eb-92ea-107c21eb512c None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:44.573187 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46eff-1719-42eb-92ea-107c21eb512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:44.592820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9ee46eff-1719-42eb-92ea-107c21eb512c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:44.594051 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9ee46eff-1719-42eb-92ea-107c21eb512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:44.652993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1343/2683] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:44.660869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd878d6-23b0-4935-b3af-a0127776716b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:44.661157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd878d6-23b0-4935-b3af-a0127776716b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:44.661441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd878d6-23b0-4935-b3af-a0127776716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:44.681573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-efd878d6-23b0-4935-b3af-a0127776716b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:44.682823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-efd878d6-23b0-4935-b3af-a0127776716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:44.690753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1341/2684] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:44.695609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee46eff-1719-42eb-92ea-107c21eb512c None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:44.705576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee46eff-1719-42eb-92ea-107c21eb512c None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:44.710440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138fc74-98cd-4e99-9e71-c611774b19d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:44.711193 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138fc74-98cd-4e99-9e71-c611774b19d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:44.711478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138fc74-98cd-4e99-9e71-c611774b19d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:44.711756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138fc74-98cd-4e99-9e71-c611774b19d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:44.712406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138fc74-98cd-4e99-9e71-c611774b19d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:38:44.712713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138fc74-98cd-4e99-9e71-c611774b19d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:44.714342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138fc74-98cd-4e99-9e71-c611774b19d0 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:44.726434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1344/2685] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:38:44.731100 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd878d6-23b0-4935-b3af-a0127776716b None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:44.741281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd878d6-23b0-4935-b3af-a0127776716b None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:44.746190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8380c-5621-4bf5-ac12-66bec6628d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:44.746785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8380c-5621-4bf5-ac12-66bec6628d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:44.747062 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8380c-5621-4bf5-ac12-66bec6628d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:44.747330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8380c-5621-4bf5-ac12-66bec6628d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:44.747997 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8380c-5621-4bf5-ac12-66bec6628d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:44.749938 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8380c-5621-4bf5-ac12-66bec6628d43 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:44.846266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1342/2686] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:44 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:38:44.851183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138fc74-98cd-4e99-9e71-c611774b19d0 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:44.862816 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138fc74-98cd-4e99-9e71-c611774b19d0 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:44.892236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:44.923406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2477c-6faa-4d2d-a944-ec3bd8ea7d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:44.924014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2477c-6faa-4d2d-a944-ec3bd8ea7d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:44.924293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2477c-6faa-4d2d-a944-ec3bd8ea7d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:44.924570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2477c-6faa-4d2d-a944-ec3bd8ea7d8e admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:44.925194 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2477c-6faa-4d2d-a944-ec3bd8ea7d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:44.927705 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2477c-6faa-4d2d-a944-ec3bd8ea7d8e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:45.007598 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1345/2687] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:44 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:45.011776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8380c-5621-4bf5-ac12-66bec6628d43 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:45.022467 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8380c-5621-4bf5-ac12-66bec6628d43 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:45.027358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac066f-e4bd-47df-8aff-bc29e0f8fed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:45.027993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac066f-e4bd-47df-8aff-bc29e0f8fed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.028277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac066f-e4bd-47df-8aff-bc29e0f8fed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.028555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac066f-e4bd-47df-8aff-bc29e0f8fed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.029200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac066f-e4bd-47df-8aff-bc29e0f8fed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:45.030833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac066f-e4bd-47df-8aff-bc29e0f8fed1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:45.041660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1343/2688] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:45.045717 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2477c-6faa-4d2d-a944-ec3bd8ea7d8e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:45.056765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2477c-6faa-4d2d-a944-ec3bd8ea7d8e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:45.061473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e1777-872f-4a85-8dac-61556d84409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:45.062108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1777-872f-4a85-8dac-61556d84409f admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.062382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1777-872f-4a85-8dac-61556d84409f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.062656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1777-872f-4a85-8dac-61556d84409f admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.063870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e1777-872f-4a85-8dac-61556d84409f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:45.064896 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e1777-872f-4a85-8dac-61556d84409f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:45.075443 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1346/2689] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:45.079406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac066f-e4bd-47df-8aff-bc29e0f8fed1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:45.089400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac066f-e4bd-47df-8aff-bc29e0f8fed1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:45.094085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3b333-5734-4686-b461-239a2ae3b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:45.094734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3b333-5734-4686-b461-239a2ae3b9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.095021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3b333-5734-4686-b461-239a2ae3b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.095301 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3b333-5734-4686-b461-239a2ae3b9ff admin admin] PATH_INFO: `/v3/projects/e8325c5a234d4df1a8efb007f8f7f44f/users/be7bc6ed376d4af5a996a4516881921a/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.110407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3b333-5734-4686-b461-239a2ae3b9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8325c5a234d4df1a8efb007f8f7f44f, user_id=be7bc6ed376d4af5a996a4516881921a, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:45.113053 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3b333-5734-4686-b461-239a2ae3b9ff admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:45.221914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1344/2690] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:45 2022] PUT /identity/v3/projects/e8325c5a234d4df1a8efb007f8f7f44f/users/be7bc6ed376d4af5a996a4516881921a/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:45.232950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b06beb-96d4-4ce9-b853-5c923d22df48 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.233287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b06beb-96d4-4ce9-b853-5c923d22df48 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.233565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b06beb-96d4-4ce9-b853-5c923d22df48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.261653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-b2b06beb-96d4-4ce9-b853-5c923d22df48 None None] MFA Rules not processed for user `be7bc6ed376d4af5a996a4516881921a`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:45.262787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b2b06beb-96d4-4ce9-b853-5c923d22df48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:45.325163 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1347/2691] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:45.329744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3b333-5734-4686-b461-239a2ae3b9ff admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:45.391507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3b333-5734-4686-b461-239a2ae3b9ff admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:45.396775 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79280825-7301-406f-8856-a3337ecb680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:45.397378 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79280825-7301-406f-8856-a3337ecb680c admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.397658 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79280825-7301-406f-8856-a3337ecb680c admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.397972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79280825-7301-406f-8856-a3337ecb680c admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.398598 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79280825-7301-406f-8856-a3337ecb680c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:45.400476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79280825-7301-406f-8856-a3337ecb680c admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:45.521046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1345/2692] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:45 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:45.525247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b06beb-96d4-4ce9-b853-5c923d22df48 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:45.536711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b06beb-96d4-4ce9-b853-5c923d22df48 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:45.594080 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76037821-f054-499b-a2e1-7734350b844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:45.594782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76037821-f054-499b-a2e1-7734350b844c admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.594951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76037821-f054-499b-a2e1-7734350b844c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.595224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76037821-f054-499b-a2e1-7734350b844c admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.595852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76037821-f054-499b-a2e1-7734350b844c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:45.597807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76037821-f054-499b-a2e1-7734350b844c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:45.708345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1348/2693] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:45 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:45.712145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79280825-7301-406f-8856-a3337ecb680c admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:45.722830 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79280825-7301-406f-8856-a3337ecb680c admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:45.727955 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e3499-1197-4f4d-8b92-0e1559dce339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:45.728609 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3499-1197-4f4d-8b92-0e1559dce339 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.728897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3499-1197-4f4d-8b92-0e1559dce339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.729171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3499-1197-4f4d-8b92-0e1559dce339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.729844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e3499-1197-4f4d-8b92-0e1559dce339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:45.731691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e3499-1197-4f4d-8b92-0e1559dce339 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:45.743217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1346/2694] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:45.747968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76037821-f054-499b-a2e1-7734350b844c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:45.758105 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76037821-f054-499b-a2e1-7734350b844c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:45.762761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef6f67-96a7-442b-a26b-66dbcca3f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:45.763415 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef6f67-96a7-442b-a26b-66dbcca3f7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.763699 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef6f67-96a7-442b-a26b-66dbcca3f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.763977 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef6f67-96a7-442b-a26b-66dbcca3f7ff admin admin] PATH_INFO: `/v3/projects/6efb5345ab9c476ab4bedb56f34145ad/users/3b7c8f62ecfe48709e6e001c7b0439d7/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.778470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef6f67-96a7-442b-a26b-66dbcca3f7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efb5345ab9c476ab4bedb56f34145ad, user_id=3b7c8f62ecfe48709e6e001c7b0439d7, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:45.781042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef6f67-96a7-442b-a26b-66dbcca3f7ff admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:45.914581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1349/2695] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:45 2022] PUT /identity/v3/projects/6efb5345ab9c476ab4bedb56f34145ad/users/3b7c8f62ecfe48709e6e001c7b0439d7/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:38:45.918584 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e3499-1197-4f4d-8b92-0e1559dce339 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:45.930315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e3499-1197-4f4d-8b92-0e1559dce339 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:45.952912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:45.986596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf8d54-777e-49dc-83de-9398831e7c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:45.987207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf8d54-777e-49dc-83de-9398831e7c79 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:45.987489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf8d54-777e-49dc-83de-9398831e7c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:45.987766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf8d54-777e-49dc-83de-9398831e7c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:45.988409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf8d54-777e-49dc-83de-9398831e7c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:45.990707 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf8d54-777e-49dc-83de-9398831e7c79 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:46.000649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1347/2696] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:46.005235 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef6f67-96a7-442b-a26b-66dbcca3f7ff admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:46.010608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:46.015808 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef6f67-96a7-442b-a26b-66dbcca3f7ff admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:46.021307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c8119-647e-4c9c-95d9-b6b8e33bde01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:46.021999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c8119-647e-4c9c-95d9-b6b8e33bde01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:46.022287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c8119-647e-4c9c-95d9-b6b8e33bde01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:46.022590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c8119-647e-4c9c-95d9-b6b8e33bde01 admin admin] PATH_INFO: `/v3/projects/6efb5345ab9c476ab4bedb56f34145ad/users/3b7c8f62ecfe48709e6e001c7b0439d7/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:46.024477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c8119-647e-4c9c-95d9-b6b8e33bde01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efb5345ab9c476ab4bedb56f34145ad, user_id=3b7c8f62ecfe48709e6e001c7b0439d7, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:46.027152 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c8119-647e-4c9c-95d9-b6b8e33bde01 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:46.038011 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1350/2697] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:46 2022] PUT /identity/v3/projects/6efb5345ab9c476ab4bedb56f34145ad/users/3b7c8f62ecfe48709e6e001c7b0439d7/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:46.049523 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e2ea5-7c54-4331-8dce-1de9c08537a6 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:46.050127 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e2ea5-7c54-4331-8dce-1de9c08537a6 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:46.050687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e2ea5-7c54-4331-8dce-1de9c08537a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:46.078628 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-849e2ea5-7c54-4331-8dce-1de9c08537a6 None None] MFA Rules not processed for user `3b7c8f62ecfe48709e6e001c7b0439d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:46.079831 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-849e2ea5-7c54-4331-8dce-1de9c08537a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:46.145922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1348/2698] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:46.158437 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c8119-647e-4c9c-95d9-b6b8e33bde01 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:46.167530 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-658c8119-647e-4c9c-95d9-b6b8e33bde01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:46.218804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c8119-647e-4c9c-95d9-b6b8e33bde01 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:46.222480 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c99f2-8a99-4eba-9290-998abaafbc86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:46.223697 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c99f2-8a99-4eba-9290-998abaafbc86 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:46.224013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c99f2-8a99-4eba-9290-998abaafbc86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:46.224257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c99f2-8a99-4eba-9290-998abaafbc86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:46.233580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c99f2-8a99-4eba-9290-998abaafbc86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:46.239298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c99f2-8a99-4eba-9290-998abaafbc86 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:46.245753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1351/2699] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:38:47.687095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e2ea5-7c54-4331-8dce-1de9c08537a6 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:47.696298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e2ea5-7c54-4331-8dce-1de9c08537a6 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:47.700903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0329d-6efb-4c67-8dd7-e5ef8713811b tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b7c8f62ecfe48709e6e001c7b0439d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6efb5345ab9c476ab4bedb56f34145ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:47.701506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0329d-6efb-4c67-8dd7-e5ef8713811b tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:47.701824 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0329d-6efb-4c67-8dd7-e5ef8713811b tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:47.702108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0329d-6efb-4c67-8dd7-e5ef8713811b tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:47.702761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0329d-6efb-4c67-8dd7-e5ef8713811b tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:38:47.703098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0329d-6efb-4c67-8dd7-e5ef8713811b tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:47.704699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0329d-6efb-4c67-8dd7-e5ef8713811b tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:47.716874 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1349/2700] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:38:47.721195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c99f2-8a99-4eba-9290-998abaafbc86 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:47.730824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c99f2-8a99-4eba-9290-998abaafbc86 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:47.735674 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f79f1-bc6c-40e5-879c-32b70a0b31b1 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b7c8f62ecfe48709e6e001c7b0439d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6efb5345ab9c476ab4bedb56f34145ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:47.736291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f79f1-bc6c-40e5-879c-32b70a0b31b1 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:47.736582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f79f1-bc6c-40e5-879c-32b70a0b31b1 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:47.736856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f79f1-bc6c-40e5-879c-32b70a0b31b1 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:47.737492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f79f1-bc6c-40e5-879c-32b70a0b31b1 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:47.739403 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f79f1-bc6c-40e5-879c-32b70a0b31b1 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:47.852945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1352/2701] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:47 2022] POST /identity/v3/projects => generated 353 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:47.857616 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0329d-6efb-4c67-8dd7-e5ef8713811b tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:47.867772 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0329d-6efb-4c67-8dd7-e5ef8713811b tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:47.924017 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1506e-283f-4800-902f-58a4d3164a2c tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b7c8f62ecfe48709e6e001c7b0439d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6efb5345ab9c476ab4bedb56f34145ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:47.924544 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1506e-283f-4800-902f-58a4d3164a2c tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:47.924827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1506e-283f-4800-902f-58a4d3164a2c tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:47.925107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1506e-283f-4800-902f-58a4d3164a2c tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:47.926725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1506e-283f-4800-902f-58a4d3164a2c tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:38:47.927076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1506e-283f-4800-902f-58a4d3164a2c tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:47.928781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1506e-283f-4800-902f-58a4d3164a2c tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:47.940831 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1350/2702] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:38:47.978328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f79f1-bc6c-40e5-879c-32b70a0b31b1 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:47.989284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f79f1-bc6c-40e5-879c-32b70a0b31b1 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:47.993764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b7c8f62ecfe48709e6e001c7b0439d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6efb5345ab9c476ab4bedb56f34145ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:47.994377 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:47.994659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:47.994930 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] PATH_INFO: `/v3/projects/539667015cb04f46a9045b5b60dd22fc` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:47.996035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: Authorizing `identity:delete_project(project_id=539667015cb04f46a9045b5b60dd22fc)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:47.997953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:48.156638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539667015cb04f46a9045b5b60dd22fc', 'request_id': 'req-ce657e94-5133-4304-8a56-7b96cf038af8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:48.163787 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539667015cb04f46a9045b5b60dd22fc', 'request_id': 'req-ce657e94-5133-4304-8a56-7b96cf038af8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:48.347235 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539667015cb04f46a9045b5b60dd22fc', 'request_id': 'req-ce657e94-5133-4304-8a56-7b96cf038af8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:48.359713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] The token cache is being invalidate because project 539667015cb04f46a9045b5b60dd22fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:48.359995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:48.360739 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ce657e94-5133-4304-8a56-7b96cf038af8 tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:48.362308 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1353/2703] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:47 2022] DELETE /identity/v3/projects/539667015cb04f46a9045b5b60dd22fc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:49.247077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1506e-283f-4800-902f-58a4d3164a2c tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:49.248882 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ebb1506e-283f-4800-902f-58a4d3164a2c tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:49.281231 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:49.314703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1506e-283f-4800-902f-58a4d3164a2c tempest-VolumeQuotaClassesTest-1176319461 tempest-VolumeQuotaClassesTest-1176319461-project-admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:49.373610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:49.374272 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:49.374552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:49.374827 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] PATH_INFO: `/v3/users/be7bc6ed376d4af5a996a4516881921a` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:49.376073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7bc6ed376d4af5a996a4516881921a)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:49.378057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:49.735959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7bc6ed376d4af5a996a4516881921a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:49.882317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7bc6ed376d4af5a996a4516881921a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:49.882940 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7bc6ed376d4af5a996a4516881921a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:49.896205 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7bc6ed376d4af5a996a4516881921a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:49.896851 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7bc6ed376d4af5a996a4516881921a'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:49.909203 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1351/2704] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:49 2022] DELETE /identity/v3/users/be7bc6ed376d4af5a996a4516881921a => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:49.914374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c045b74-4fb5-4030-9063-aa0808d6bdd9 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:49.914844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c045b74-4fb5-4030-9063-aa0808d6bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:49.914959 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c045b74-4fb5-4030-9063-aa0808d6bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:49.933707 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-5c045b74-4fb5-4030-9063-aa0808d6bdd9 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:49.934937 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5c045b74-4fb5-4030-9063-aa0808d6bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:49.982320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:49.994255 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1354/2705] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:38:50.003914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:50.005367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:50.067039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90793e-8823-4eaa-ad73-b6f1441edf68 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:50.070607 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dacfcd-a1ac-4a17-9260-2783312351b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:50.071205 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacfcd-a1ac-4a17-9260-2783312351b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:50.071482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacfcd-a1ac-4a17-9260-2783312351b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:50.071950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacfcd-a1ac-4a17-9260-2783312351b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:50.078680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:50.081157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dacfcd-a1ac-4a17-9260-2783312351b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:50.083220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dacfcd-a1ac-4a17-9260-2783312351b7 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:50.092376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1352/2706] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:50.538191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c045b74-4fb5-4030-9063-aa0808d6bdd9 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:50.539747 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5c045b74-4fb5-4030-9063-aa0808d6bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:50.551991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c045b74-4fb5-4030-9063-aa0808d6bdd9 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:50.556829 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:50.557522 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:50.557838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:50.558119 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] PATH_INFO: `/v3/projects/e8325c5a234d4df1a8efb007f8f7f44f` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:50.559250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8325c5a234d4df1a8efb007f8f7f44f)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:50.561266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:50.717269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8325c5a234d4df1a8efb007f8f7f44f', 'request_id': 'req-b3585b6a-84ac-42e5-911e-2c7e6650a283'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:50.723919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8325c5a234d4df1a8efb007f8f7f44f', 'request_id': 'req-b3585b6a-84ac-42e5-911e-2c7e6650a283'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:50.850750 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8325c5a234d4df1a8efb007f8f7f44f', 'request_id': 'req-b3585b6a-84ac-42e5-911e-2c7e6650a283'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:50.862792 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] The token cache is being invalidate because project e8325c5a234d4df1a8efb007f8f7f44f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:50.863209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:50.863891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:50.865478 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1355/2707] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:50 2022] DELETE /identity/v3/projects/e8325c5a234d4df1a8efb007f8f7f44f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:50.869844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dacfcd-a1ac-4a17-9260-2783312351b7 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:50.880087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dacfcd-a1ac-4a17-9260-2783312351b7 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:50.937578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:50.938244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:50.938524 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:50.938800 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] PATH_INFO: `/v3/users/3b7c8f62ecfe48709e6e001c7b0439d7` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:50.939930 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7c8f62ecfe48709e6e001c7b0439d7)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:50.942376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:51.255633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7c8f62ecfe48709e6e001c7b0439d7'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:51.341635 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7c8f62ecfe48709e6e001c7b0439d7'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:51.342296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7c8f62ecfe48709e6e001c7b0439d7'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:51.355847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7c8f62ecfe48709e6e001c7b0439d7'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:51.356765 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e1698455-d738-49f1-b6a5-ba74b46e33fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7c8f62ecfe48709e6e001c7b0439d7'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:51.369363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1353/2708] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:38:50 2022] DELETE /identity/v3/users/3b7c8f62ecfe48709e6e001c7b0439d7 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:51.863436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:51.865603 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:51.879258 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3585b6a-84ac-42e5-911e-2c7e6650a283 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:51.937684 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:51.941488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:51.941488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:51.941488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] PATH_INFO: `/v3/projects/6efb5345ab9c476ab4bedb56f34145ad` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:51.941488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6efb5345ab9c476ab4bedb56f34145ad)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:51.941915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:52.096030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6efb5345ab9c476ab4bedb56f34145ad', 'request_id': 'req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:52.102807 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6efb5345ab9c476ab4bedb56f34145ad', 'request_id': 'req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:52.238923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6efb5345ab9c476ab4bedb56f34145ad', 'request_id': 'req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:52.250047 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] The token cache is being invalidate because project 6efb5345ab9c476ab4bedb56f34145ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:38:52.250332 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:52.250941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-867b17ea-3ba7-4ab5-b891-e38d6ef272bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:38:52.252426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1356/2709] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:38:51 2022] DELETE /identity/v3/projects/6efb5345ab9c476ab4bedb56f34145ad => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:52.257344 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b27bb-c869-4239-8381-616a4d6abf37 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.257866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b27bb-c869-4239-8381-616a4d6abf37 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.257962 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b27bb-c869-4239-8381-616a4d6abf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.277639 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-488b27bb-c869-4239-8381-616a4d6abf37 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:52.278876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-488b27bb-c869-4239-8381-616a4d6abf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:52.337821 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1354/2710] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:52.345468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ee5ac-f046-4652-aba6-e5a86da64167 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.345788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ee5ac-f046-4652-aba6-e5a86da64167 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.346118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ee5ac-f046-4652-aba6-e5a86da64167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.360970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:52.366494 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ed1ee5ac-f046-4652-aba6-e5a86da64167 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:52.367682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ed1ee5ac-f046-4652-aba6-e5a86da64167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:52.375342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1357/2711] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:52.380163 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b27bb-c869-4239-8381-616a4d6abf37 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:52.389914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b27bb-c869-4239-8381-616a4d6abf37 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:52.394594 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b577d-33f0-4b6d-84e8-e86f08fda00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:52.395753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b577d-33f0-4b6d-84e8-e86f08fda00b admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.396035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b577d-33f0-4b6d-84e8-e86f08fda00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.396312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b577d-33f0-4b6d-84e8-e86f08fda00b admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.397021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b577d-33f0-4b6d-84e8-e86f08fda00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:38:52.397308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b577d-33f0-4b6d-84e8-e86f08fda00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:52.398928 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b577d-33f0-4b6d-84e8-e86f08fda00b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:52.410455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1355/2712] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:38:52.414636 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ee5ac-f046-4652-aba6-e5a86da64167 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:52.423564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ee5ac-f046-4652-aba6-e5a86da64167 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:52.428470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8cdbb-2e8f-4d91-baa7-260a13ed6be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:52.429071 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8cdbb-2e8f-4d91-baa7-260a13ed6be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.429354 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8cdbb-2e8f-4d91-baa7-260a13ed6be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.429627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8cdbb-2e8f-4d91-baa7-260a13ed6be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.430315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8cdbb-2e8f-4d91-baa7-260a13ed6be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:52.432254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8cdbb-2e8f-4d91-baa7-260a13ed6be3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:52.543474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1358/2713] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:52 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:52.547696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b577d-33f0-4b6d-84e8-e86f08fda00b admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:52.552882 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:52.558409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b577d-33f0-4b6d-84e8-e86f08fda00b admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:52.622464 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1faefa-9f6c-4ec9-8eb3-a53079505343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:52.622984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1faefa-9f6c-4ec9-8eb3-a53079505343 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.623283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1faefa-9f6c-4ec9-8eb3-a53079505343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.623537 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1faefa-9f6c-4ec9-8eb3-a53079505343 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.624178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1faefa-9f6c-4ec9-8eb3-a53079505343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:52.626197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1faefa-9f6c-4ec9-8eb3-a53079505343 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:52.719233 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1356/2714] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:52 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:52.723434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8cdbb-2e8f-4d91-baa7-260a13ed6be3 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:52.734311 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8cdbb-2e8f-4d91-baa7-260a13ed6be3 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:52.739475 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f485e7-d294-45f6-8c5d-c6b52c53b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:52.740102 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f485e7-d294-45f6-8c5d-c6b52c53b712 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.740382 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f485e7-d294-45f6-8c5d-c6b52c53b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.740653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f485e7-d294-45f6-8c5d-c6b52c53b712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.741290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f485e7-d294-45f6-8c5d-c6b52c53b712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:52.742912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f485e7-d294-45f6-8c5d-c6b52c53b712 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:52.752996 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1359/2715] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:52.758057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1faefa-9f6c-4ec9-8eb3-a53079505343 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:52.767916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1faefa-9f6c-4ec9-8eb3-a53079505343 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:52.772468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd4913-9342-422e-ac73-033b99f10c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:52.773084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd4913-9342-422e-ac73-033b99f10c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.773364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd4913-9342-422e-ac73-033b99f10c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.773636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd4913-9342-422e-ac73-033b99f10c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.774348 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd4913-9342-422e-ac73-033b99f10c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:52.775950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd4913-9342-422e-ac73-033b99f10c2b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:52.786455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1357/2716] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:52.790580 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f485e7-d294-45f6-8c5d-c6b52c53b712 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:52.800367 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f485e7-d294-45f6-8c5d-c6b52c53b712 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:52.805581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7f63c-b4e5-4366-a848-c2019cfe7cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:52.806256 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7f63c-b4e5-4366-a848-c2019cfe7cce admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.806535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7f63c-b4e5-4366-a848-c2019cfe7cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.806811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7f63c-b4e5-4366-a848-c2019cfe7cce admin admin] PATH_INFO: `/v3/projects/95397b3378254f1796741793f9c54cb2/users/56da5c1238b94ecb914c9358187a64d8/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.822028 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7f63c-b4e5-4366-a848-c2019cfe7cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=95397b3378254f1796741793f9c54cb2, user_id=56da5c1238b94ecb914c9358187a64d8, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:52.824749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7f63c-b4e5-4366-a848-c2019cfe7cce admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:52.895627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1360/2717] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:52 2022] PUT /identity/v3/projects/95397b3378254f1796741793f9c54cb2/users/56da5c1238b94ecb914c9358187a64d8/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:52.907286 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0de7f0-d353-48a7-80ce-4b7722bdcbfc None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:52.907573 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0de7f0-d353-48a7-80ce-4b7722bdcbfc None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:52.907860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0de7f0-d353-48a7-80ce-4b7722bdcbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:52.936555 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-7d0de7f0-d353-48a7-80ce-4b7722bdcbfc None None] MFA Rules not processed for user `56da5c1238b94ecb914c9358187a64d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:52.937810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7d0de7f0-d353-48a7-80ce-4b7722bdcbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:53.003093 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1358/2718] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:53.008288 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7f63c-b4e5-4366-a848-c2019cfe7cce admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:53.068131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7f63c-b4e5-4366-a848-c2019cfe7cce admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:53.072941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a1c4b-7fe4-4a9c-ab52-cfaf583db5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:53.073576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a1c4b-7fe4-4a9c-ab52-cfaf583db5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:53.073890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a1c4b-7fe4-4a9c-ab52-cfaf583db5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:53.074168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a1c4b-7fe4-4a9c-ab52-cfaf583db5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:53.074802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a1c4b-7fe4-4a9c-ab52-cfaf583db5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:53.076744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a1c4b-7fe4-4a9c-ab52-cfaf583db5c4 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:53.194309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1361/2719] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:38:53 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:53.198384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0de7f0-d353-48a7-80ce-4b7722bdcbfc None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:53.209147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0de7f0-d353-48a7-80ce-4b7722bdcbfc None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:53.267459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e9fde-02aa-4d04-bb15-f9ed012b55d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:53.268135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e9fde-02aa-4d04-bb15-f9ed012b55d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:53.268334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e9fde-02aa-4d04-bb15-f9ed012b55d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:53.268608 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e9fde-02aa-4d04-bb15-f9ed012b55d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:53.269249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e9fde-02aa-4d04-bb15-f9ed012b55d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:53.271780 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e9fde-02aa-4d04-bb15-f9ed012b55d1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:53.445992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:53.451010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1359/2720] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:38:53 2022] POST /identity/v3/users => generated 303 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:38:53.455112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a1c4b-7fe4-4a9c-ab52-cfaf583db5c4 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:53.478406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a1c4b-7fe4-4a9c-ab52-cfaf583db5c4 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:53.478406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e87de-402f-4a0d-b27c-7f6ed2e87954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:53.478406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e87de-402f-4a0d-b27c-7f6ed2e87954 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:53.478406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e87de-402f-4a0d-b27c-7f6ed2e87954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:53.478828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e87de-402f-4a0d-b27c-7f6ed2e87954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:53.478828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e87de-402f-4a0d-b27c-7f6ed2e87954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:53.478828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e87de-402f-4a0d-b27c-7f6ed2e87954 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:53.484557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1362/2721] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:53.489168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e9fde-02aa-4d04-bb15-f9ed012b55d1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:53.499554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e9fde-02aa-4d04-bb15-f9ed012b55d1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:53.504572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76f38c-f979-468c-9d83-d8171454591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:53.505259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76f38c-f979-468c-9d83-d8171454591c admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:53.505553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76f38c-f979-468c-9d83-d8171454591c admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:53.506520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76f38c-f979-468c-9d83-d8171454591c admin admin] PATH_INFO: `/v3/projects/9aa4be16a1d04d8ca8cf3c4a81a3605f/users/2b40113eea9a454ca792cbfe61e4e6dd/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:53.521864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76f38c-f979-468c-9d83-d8171454591c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa4be16a1d04d8ca8cf3c4a81a3605f, user_id=2b40113eea9a454ca792cbfe61e4e6dd, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:53.529982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76f38c-f979-468c-9d83-d8171454591c admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:53.728055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1360/2722] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:53 2022] PUT /identity/v3/projects/9aa4be16a1d04d8ca8cf3c4a81a3605f/users/2b40113eea9a454ca792cbfe61e4e6dd/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:53.732762 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e87de-402f-4a0d-b27c-7f6ed2e87954 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:53.743263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e87de-402f-4a0d-b27c-7f6ed2e87954 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:53.798609 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf03d1-28fb-43e9-bc9b-c7b77137e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:53.799214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf03d1-28fb-43e9-bc9b-c7b77137e9ae admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:53.799488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf03d1-28fb-43e9-bc9b-c7b77137e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:53.799750 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf03d1-28fb-43e9-bc9b-c7b77137e9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:53.800379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf03d1-28fb-43e9-bc9b-c7b77137e9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:53.802517 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf03d1-28fb-43e9-bc9b-c7b77137e9ae admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:53.812033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1363/2723] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:38:53.816193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76f38c-f979-468c-9d83-d8171454591c admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:53.827468 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76f38c-f979-468c-9d83-d8171454591c admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:53.832421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb2daa-01c0-43e8-bc08-ab38e7c12368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:53.833084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb2daa-01c0-43e8-bc08-ab38e7c12368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:53.833364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb2daa-01c0-43e8-bc08-ab38e7c12368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:53.833640 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb2daa-01c0-43e8-bc08-ab38e7c12368 admin admin] PATH_INFO: `/v3/projects/9aa4be16a1d04d8ca8cf3c4a81a3605f/users/2b40113eea9a454ca792cbfe61e4e6dd/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:53.835611 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb2daa-01c0-43e8-bc08-ab38e7c12368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa4be16a1d04d8ca8cf3c4a81a3605f, user_id=2b40113eea9a454ca792cbfe61e4e6dd, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:53.838333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb2daa-01c0-43e8-bc08-ab38e7c12368 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:53.849120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1361/2724] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:38:53 2022] PUT /identity/v3/projects/9aa4be16a1d04d8ca8cf3c4a81a3605f/users/2b40113eea9a454ca792cbfe61e4e6dd/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:38:53.859746 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2160d-2c43-490c-9a21-3ee35228d8da None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:53.860027 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2160d-2c43-490c-9a21-3ee35228d8da None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:53.860302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2160d-2c43-490c-9a21-3ee35228d8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:53.885850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:53.888709 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-34f2160d-2c43-490c-9a21-3ee35228d8da None None] MFA Rules not processed for user `2b40113eea9a454ca792cbfe61e4e6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:38:53.889933 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-34f2160d-2c43-490c-9a21-3ee35228d8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:53.957245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1364/2725] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:38:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:38:53.968206 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb2daa-01c0-43e8-bc08-ab38e7c12368 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:53.970130 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-42cb2daa-01c0-43e8-bc08-ab38e7c12368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:54.027791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb2daa-01c0-43e8-bc08-ab38e7c12368 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:54.031386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b22e47-5ff6-453e-9425-58bf3e74188f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:54.032021 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b22e47-5ff6-453e-9425-58bf3e74188f service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:54.032300 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b22e47-5ff6-453e-9425-58bf3e74188f service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:54.032570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b22e47-5ff6-453e-9425-58bf3e74188f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:54.042965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b22e47-5ff6-453e-9425-58bf3e74188f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:54.044403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b22e47-5ff6-453e-9425-58bf3e74188f service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:54.054700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1362/2726] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:38:54.101622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2160d-2c43-490c-9a21-3ee35228d8da None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:38:54.103064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-34f2160d-2c43-490c-9a21-3ee35228d8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:38:54.116068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2160d-2c43-490c-9a21-3ee35228d8da None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:38:54.119686 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabf167-cb0f-4f38-91e8-76555561db62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:38:54.120283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf167-cb0f-4f38-91e8-76555561db62 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:38:54.120563 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf167-cb0f-4f38-91e8-76555561db62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:38:54.120835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf167-cb0f-4f38-91e8-76555561db62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:38:54.177424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabf167-cb0f-4f38-91e8-76555561db62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:38:54.178918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabf167-cb0f-4f38-91e8-76555561db62 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:38:54.187732 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1365/2727] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:38:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:01.362339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b22e47-5ff6-453e-9425-58bf3e74188f service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:01.424220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b22e47-5ff6-453e-9425-58bf3e74188f service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:01.429422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:01.430076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:01.430364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:01.430643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] PATH_INFO: `/v3/users/56da5c1238b94ecb914c9358187a64d8` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:01.432118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] RBAC: Authorizing `identity:delete_user(user_id=56da5c1238b94ecb914c9358187a64d8)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:01.434219 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:01.646517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56da5c1238b94ecb914c9358187a64d8'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:01.745319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56da5c1238b94ecb914c9358187a64d8'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:01.746038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56da5c1238b94ecb914c9358187a64d8'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:01.757622 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:01.759859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56da5c1238b94ecb914c9358187a64d8'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:01.760514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56da5c1238b94ecb914c9358187a64d8'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:01.772409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1363/2728] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:01 2022] DELETE /identity/v3/users/56da5c1238b94ecb914c9358187a64d8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:01.776917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ada71f-7fef-422c-9026-271695a94c13 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:01.777372 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ada71f-7fef-422c-9026-271695a94c13 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:01.777495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ada71f-7fef-422c-9026-271695a94c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:01.796637 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-01ada71f-7fef-422c-9026-271695a94c13 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:01.797867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-01ada71f-7fef-422c-9026-271695a94c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:01.857734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1366/2729] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:01.868945 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:01.870249 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:01.927729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc9d6c-a142-4c9a-9edb-e3aad3b7374b admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:01.932101 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba723-87b7-4325-b356-d6ffe406e33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:01.932842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba723-87b7-4325-b356-d6ffe406e33f service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:01.936239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba723-87b7-4325-b356-d6ffe406e33f service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:01.936239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba723-87b7-4325-b356-d6ffe406e33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:01.943036 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ba723-87b7-4325-b356-d6ffe406e33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:01.944459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ba723-87b7-4325-b356-d6ffe406e33f service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:01.954080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1364/2730] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:02.383585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ada71f-7fef-422c-9026-271695a94c13 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:02.385037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-01ada71f-7fef-422c-9026-271695a94c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:02.401005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ada71f-7fef-422c-9026-271695a94c13 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:02.406992 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:02.407626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:02.407912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:02.408186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] PATH_INFO: `/v3/projects/95397b3378254f1796741793f9c54cb2` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:02.409470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95397b3378254f1796741793f9c54cb2)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:02.412061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:02.521349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:02.534538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95397b3378254f1796741793f9c54cb2', 'request_id': 'req-39039b40-2234-49ac-ad45-3640ee5eff71'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:02.540870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95397b3378254f1796741793f9c54cb2', 'request_id': 'req-39039b40-2234-49ac-ad45-3640ee5eff71'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:02.607649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95397b3378254f1796741793f9c54cb2', 'request_id': 'req-39039b40-2234-49ac-ad45-3640ee5eff71'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:02.618600 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] The token cache is being invalidate because project 95397b3378254f1796741793f9c54cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:02.619181 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:02.620723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:02.622267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1367/2731] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:02 2022] DELETE /identity/v3/projects/95397b3378254f1796741793f9c54cb2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:02.626479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba723-87b7-4325-b356-d6ffe406e33f service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:02.636670 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba723-87b7-4325-b356-d6ffe406e33f service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:02.693648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:02.694308 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:02.694641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:02.694899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] PATH_INFO: `/v3/users/2b40113eea9a454ca792cbfe61e4e6dd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:02.696028 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b40113eea9a454ca792cbfe61e4e6dd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:02.698046 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:02.987773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b40113eea9a454ca792cbfe61e4e6dd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.055764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b40113eea9a454ca792cbfe61e4e6dd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.056408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b40113eea9a454ca792cbfe61e4e6dd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.069758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b40113eea9a454ca792cbfe61e4e6dd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.070434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b55034aa-7fe4-41e5-9ba7-06ee219edb9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b40113eea9a454ca792cbfe61e4e6dd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.082492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1365/2732] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:39:02 2022] DELETE /identity/v3/users/2b40113eea9a454ca792cbfe61e4e6dd => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:03.579945 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:03.581432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:03.595360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39039b40-2234-49ac-ad45-3640ee5eff71 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:03.658410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:03.659048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:03.659322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:03.659590 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] PATH_INFO: `/v3/projects/9aa4be16a1d04d8ca8cf3c4a81a3605f` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:03.661321 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa4be16a1d04d8ca8cf3c4a81a3605f)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:03.663266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:03.763186 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa4be16a1d04d8ca8cf3c4a81a3605f', 'request_id': 'req-728d5378-e6b7-482d-9724-05dc8911c02f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.769626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa4be16a1d04d8ca8cf3c4a81a3605f', 'request_id': 'req-728d5378-e6b7-482d-9724-05dc8911c02f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.850891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa4be16a1d04d8ca8cf3c4a81a3605f', 'request_id': 'req-728d5378-e6b7-482d-9724-05dc8911c02f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.862206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] The token cache is being invalidate because project 9aa4be16a1d04d8ca8cf3c4a81a3605f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:39:03.862484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.863137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-728d5378-e6b7-482d-9724-05dc8911c02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:39:03.864622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1368/2733] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:39:03 2022] DELETE /identity/v3/projects/9aa4be16a1d04d8ca8cf3c4a81a3605f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:39:03.870816 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9363fa7-ca83-4797-a2e8-723d2dc9e76c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:03.871334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9363fa7-ca83-4797-a2e8-723d2dc9e76c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:03.871487 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9363fa7-ca83-4797-a2e8-723d2dc9e76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:03.884816 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:03.890922 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-e9363fa7-ca83-4797-a2e8-723d2dc9e76c None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:03.892118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-e9363fa7-ca83-4797-a2e8-723d2dc9e76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:03.949283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1366/2734] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:03.957139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f7f5d-c124-4417-859c-9127b99af164 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:03.958032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f7f5d-c124-4417-859c-9127b99af164 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:03.958364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f7f5d-c124-4417-859c-9127b99af164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:03.978474 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-8b9f7f5d-c124-4417-859c-9127b99af164 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:03.979681 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8b9f7f5d-c124-4417-859c-9127b99af164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:03.987870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1369/2735] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:03.992200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9363fa7-ca83-4797-a2e8-723d2dc9e76c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:04.002055 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9363fa7-ca83-4797-a2e8-723d2dc9e76c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:04.007235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5feb182-2836-4870-ae30-4ebc7f8d8d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:04.007838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feb182-2836-4870-ae30-4ebc7f8d8d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:04.008121 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feb182-2836-4870-ae30-4ebc7f8d8d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:04.008402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feb182-2836-4870-ae30-4ebc7f8d8d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:04.009110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5feb182-2836-4870-ae30-4ebc7f8d8d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:39:04.009418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5feb182-2836-4870-ae30-4ebc7f8d8d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:04.011042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5feb182-2836-4870-ae30-4ebc7f8d8d6e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:04.023520 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1367/2736] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:39:04.027773 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f7f5d-c124-4417-859c-9127b99af164 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:04.036929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f7f5d-c124-4417-859c-9127b99af164 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:04.041744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cc8b7-9128-4e7f-88d1-85eecc5b8176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:04.042246 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cc8b7-9128-4e7f-88d1-85eecc5b8176 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:04.042528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cc8b7-9128-4e7f-88d1-85eecc5b8176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:04.042802 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cc8b7-9128-4e7f-88d1-85eecc5b8176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:04.043548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cc8b7-9128-4e7f-88d1-85eecc5b8176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:04.045453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cc8b7-9128-4e7f-88d1-85eecc5b8176 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:04.132548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1370/2737] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:39:04 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:04.136644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5feb182-2836-4870-ae30-4ebc7f8d8d6e admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:04.147481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5feb182-2836-4870-ae30-4ebc7f8d8d6e admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:04.203188 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47ed6d-23a8-4aeb-b151-06e1a3b5f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:04.203843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47ed6d-23a8-4aeb-b151-06e1a3b5f22a admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:04.204123 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47ed6d-23a8-4aeb-b151-06e1a3b5f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:04.204397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47ed6d-23a8-4aeb-b151-06e1a3b5f22a admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:04.205173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47ed6d-23a8-4aeb-b151-06e1a3b5f22a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:04.207114 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47ed6d-23a8-4aeb-b151-06e1a3b5f22a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:04.322549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1368/2738] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:39:04 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:39:04.326576 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cc8b7-9128-4e7f-88d1-85eecc5b8176 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:04.337349 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cc8b7-9128-4e7f-88d1-85eecc5b8176 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:04.341835 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698fb0-7f50-48d2-a9b9-88e7f9a6c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:04.342434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698fb0-7f50-48d2-a9b9-88e7f9a6c331 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:04.342708 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698fb0-7f50-48d2-a9b9-88e7f9a6c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:04.342979 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698fb0-7f50-48d2-a9b9-88e7f9a6c331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:04.343623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698fb0-7f50-48d2-a9b9-88e7f9a6c331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:04.345209 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698fb0-7f50-48d2-a9b9-88e7f9a6c331 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:04.355743 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1371/2739] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:04.360358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47ed6d-23a8-4aeb-b151-06e1a3b5f22a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:04.372190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47ed6d-23a8-4aeb-b151-06e1a3b5f22a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:04.380970 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feb985-0119-48f1-ab88-651581238c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:04.381879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feb985-0119-48f1-ab88-651581238c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:04.381978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feb985-0119-48f1-ab88-651581238c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:04.382236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feb985-0119-48f1-ab88-651581238c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:04.383065 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7feb985-0119-48f1-ab88-651581238c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:04.384833 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7feb985-0119-48f1-ab88-651581238c3c admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:04.398785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1369/2740] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:39:04.403734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698fb0-7f50-48d2-a9b9-88e7f9a6c331 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:04.414291 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698fb0-7f50-48d2-a9b9-88e7f9a6c331 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:04.418823 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f433c7d-8172-427c-937a-59499aafdabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:04.421422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f433c7d-8172-427c-937a-59499aafdabc admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:04.421422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f433c7d-8172-427c-937a-59499aafdabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:04.421422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f433c7d-8172-427c-937a-59499aafdabc admin admin] PATH_INFO: `/v3/projects/e9436da98d0341c4b3b8296c62464333/users/486bedc24c084ce68c56928da3fa4c8b/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:04.429634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:04.436975 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f433c7d-8172-427c-937a-59499aafdabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9436da98d0341c4b3b8296c62464333, user_id=486bedc24c084ce68c56928da3fa4c8b, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:04.440486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f433c7d-8172-427c-937a-59499aafdabc admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:04.665482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1372/2741] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:39:04 2022] PUT /identity/v3/projects/e9436da98d0341c4b3b8296c62464333/users/486bedc24c084ce68c56928da3fa4c8b/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:39:04.670913 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9e05-6c05-4a0d-a1eb-2abad5f623f5 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:04.671201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9e05-6c05-4a0d-a1eb-2abad5f623f5 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:04.671480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9e05-6c05-4a0d-a1eb-2abad5f623f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:04.691279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-257e9e05-6c05-4a0d-a1eb-2abad5f623f5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:04.696350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-257e9e05-6c05-4a0d-a1eb-2abad5f623f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:04.760792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1370/2742] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:04.770503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f433c7d-8172-427c-937a-59499aafdabc admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:04.772468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3f433c7d-8172-427c-937a-59499aafdabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:04.829328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f433c7d-8172-427c-937a-59499aafdabc admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:04.832890 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f767a-7108-4aef-9acb-ea192d797582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:04.833492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f767a-7108-4aef-9acb-ea192d797582 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:04.833967 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f767a-7108-4aef-9acb-ea192d797582 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:04.834242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f767a-7108-4aef-9acb-ea192d797582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:04.842951 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f767a-7108-4aef-9acb-ea192d797582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:04.844375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f767a-7108-4aef-9acb-ea192d797582 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:04.854164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1373/2743] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:06.138295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f7930-f3ff-45d1-96d4-58a7e6926067 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.138862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f7930-f3ff-45d1-96d4-58a7e6926067 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.138862 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f7930-f3ff-45d1-96d4-58a7e6926067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.166841 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:06.170237 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b45f7930-f3ff-45d1-96d4-58a7e6926067 None None] MFA Rules not processed for user `486bedc24c084ce68c56928da3fa4c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:06.171478 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b45f7930-f3ff-45d1-96d4-58a7e6926067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:06.240649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1371/2744] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:39:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:06.251639 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f767a-7108-4aef-9acb-ea192d797582 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:06.253076 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-184f767a-7108-4aef-9acb-ea192d797582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:06.308968 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f767a-7108-4aef-9acb-ea192d797582 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:06.312547 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c261b2c-6c99-40c0-b83d-f22261a56b6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:06.313138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c261b2c-6c99-40c0-b83d-f22261a56b6b service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:06.313416 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c261b2c-6c99-40c0-b83d-f22261a56b6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:06.313711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c261b2c-6c99-40c0-b83d-f22261a56b6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:06.322110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c261b2c-6c99-40c0-b83d-f22261a56b6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:06.323577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c261b2c-6c99-40c0-b83d-f22261a56b6b service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:06.332359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1374/2745] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:07.827507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f7930-f3ff-45d1-96d4-58a7e6926067 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:07.828950 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b45f7930-f3ff-45d1-96d4-58a7e6926067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:07.841159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f7930-f3ff-45d1-96d4-58a7e6926067 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:07.844802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95569c9e-ddf8-40c5-9c7d-eb8c67b093e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:07.845472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95569c9e-ddf8-40c5-9c7d-eb8c67b093e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:07.845754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95569c9e-ddf8-40c5-9c7d-eb8c67b093e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:07.845988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95569c9e-ddf8-40c5-9c7d-eb8c67b093e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:07.847731 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-95569c9e-ddf8-40c5-9c7d-eb8c67b093e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:07.858407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95569c9e-ddf8-40c5-9c7d-eb8c67b093e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:07.859472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95569c9e-ddf8-40c5-9c7d-eb8c67b093e2 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:07.868183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1372/2746] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:39:09.204756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2906c6-13bf-4c3d-80ea-28ffccfb4682 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:09.205314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2906c6-13bf-4c3d-80ea-28ffccfb4682 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:09.205314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2906c6-13bf-4c3d-80ea-28ffccfb4682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:09.225891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1e2906c6-13bf-4c3d-80ea-28ffccfb4682 None None] MFA Rules not processed for user `486bedc24c084ce68c56928da3fa4c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:09.227103 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1e2906c6-13bf-4c3d-80ea-28ffccfb4682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:09.234313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1375/2747] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:39:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:16.684413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95569c9e-ddf8-40c5-9c7d-eb8c67b093e2 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:16.690704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-95569c9e-ddf8-40c5-9c7d-eb8c67b093e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:16.761964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95569c9e-ddf8-40c5-9c7d-eb8c67b093e2 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:16.767580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed040e7-51ce-48e6-aee0-7a4960cc7a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:16.768192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed040e7-51ce-48e6-aee0-7a4960cc7a5a service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:16.768480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed040e7-51ce-48e6-aee0-7a4960cc7a5a service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:16.768756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed040e7-51ce-48e6-aee0-7a4960cc7a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:16.771087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2ed040e7-51ce-48e6-aee0-7a4960cc7a5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:16.783514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed040e7-51ce-48e6-aee0-7a4960cc7a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:16.785092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed040e7-51ce-48e6-aee0-7a4960cc7a5a service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:16.796753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1373/2748] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:19.219328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:26.791117 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=66 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:29.942158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dadb23-0930-4355-a6ce-f442394749c5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:29.942715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dadb23-0930-4355-a6ce-f442394749c5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:29.942715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dadb23-0930-4355-a6ce-f442394749c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:29.963932 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-24dadb23-0930-4355-a6ce-f442394749c5 None None] MFA Rules not processed for user `486bedc24c084ce68c56928da3fa4c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:29.965374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-24dadb23-0930-4355-a6ce-f442394749c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:29.972565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1376/2749] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:39:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:30.213175 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed040e7-51ce-48e6-aee0-7a4960cc7a5a service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:30.222883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed040e7-51ce-48e6-aee0-7a4960cc7a5a service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:30.226496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b407fa1-8fc1-45df-921f-134b21bf3c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:30.227131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b407fa1-8fc1-45df-921f-134b21bf3c68 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:30.227413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b407fa1-8fc1-45df-921f-134b21bf3c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:30.227687 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b407fa1-8fc1-45df-921f-134b21bf3c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:30.229569 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3b407fa1-8fc1-45df-921f-134b21bf3c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:30.240463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b407fa1-8fc1-45df-921f-134b21bf3c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:30.242027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b407fa1-8fc1-45df-921f-134b21bf3c68 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:30.251721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1374/2750] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:30.672568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dadb23-0930-4355-a6ce-f442394749c5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:30.674957 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-24dadb23-0930-4355-a6ce-f442394749c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:30.747271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dadb23-0930-4355-a6ce-f442394749c5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:30.752147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8242746-bb49-4871-a10e-fee920cd6c70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:30.752755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242746-bb49-4871-a10e-fee920cd6c70 service placement] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:30.753037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242746-bb49-4871-a10e-fee920cd6c70 service placement] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:30.753307 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242746-bb49-4871-a10e-fee920cd6c70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:30.755069 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a8242746-bb49-4871-a10e-fee920cd6c70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:30.767143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8242746-bb49-4871-a10e-fee920cd6c70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:30.768702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8242746-bb49-4871-a10e-fee920cd6c70 service placement] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:30.779442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1377/2751] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:40.248057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=6 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:40.775254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=35 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:41.353235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b407fa1-8fc1-45df-921f-134b21bf3c68 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:41.354855 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-3b407fa1-8fc1-45df-921f-134b21bf3c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.371396 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b407fa1-8fc1-45df-921f-134b21bf3c68 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:41.377356 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127c7d4-f886-4e36-9835-db995e79fc92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:41.377993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127c7d4-f886-4e36-9835-db995e79fc92 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:41.378280 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127c7d4-f886-4e36-9835-db995e79fc92 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:41.378560 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127c7d4-f886-4e36-9835-db995e79fc92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:41.380269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4127c7d4-f886-4e36-9835-db995e79fc92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:41.393305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127c7d4-f886-4e36-9835-db995e79fc92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:41.394914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127c7d4-f886-4e36-9835-db995e79fc92 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:41.406051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1375/2752] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:39:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:39:51.401798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=6 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:51.481399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb33ad7-340d-448c-8316-9bfd26c35e00 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:51.482659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb33ad7-340d-448c-8316-9bfd26c35e00 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:51.482659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb33ad7-340d-448c-8316-9bfd26c35e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:51.503297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-abb33ad7-340d-448c-8316-9bfd26c35e00 None None] MFA Rules not processed for user `827f9448c84b4a74ac4c64eb3cd57ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:51.504639 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-abb33ad7-340d-448c-8316-9bfd26c35e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:51.563061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1378/2753] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:39:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:53.199492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825e0d8-7819-4d91-b689-2f9180946b45 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.199954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825e0d8-7819-4d91-b689-2f9180946b45 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.200072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825e0d8-7819-4d91-b689-2f9180946b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.256492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-9825e0d8-7819-4d91-b689-2f9180946b45 None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:39:53.257660 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9825e0d8-7819-4d91-b689-2f9180946b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:53.325420 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1376/2754] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 31 19:39:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:39:53.495942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb33ad7-340d-448c-8316-9bfd26c35e00 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:39:53.497495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-abb33ad7-340d-448c-8316-9bfd26c35e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:39:53.592937 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb33ad7-340d-448c-8316-9bfd26c35e00 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:39:53.597902 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1310f-8ebe-43fe-89dc-f252d14cb158 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:39:53.598534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1310f-8ebe-43fe-89dc-f252d14cb158 service swift] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:39:53.598812 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1310f-8ebe-43fe-89dc-f252d14cb158 service swift] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:39:53.599082 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1310f-8ebe-43fe-89dc-f252d14cb158 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:39:53.609063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1310f-8ebe-43fe-89dc-f252d14cb158 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:39:53.610672 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1310f-8ebe-43fe-89dc-f252d14cb158 service swift] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:39:53.619675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1379/2755] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:39:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:40:03.321656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=40 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:03.615847 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=66 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:10.798618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade58cf-5fae-4df6-9035-97ed7156488c None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:10.799096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade58cf-5fae-4df6-9035-97ed7156488c None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:10.799196 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade58cf-5fae-4df6-9035-97ed7156488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:10.828519 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-2ade58cf-5fae-4df6-9035-97ed7156488c None None] MFA Rules not processed for user `de4d78d267af4fe0a6aefed603b0343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:10.829878 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-2ade58cf-5fae-4df6-9035-97ed7156488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:10.837477 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1377/2756] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 31 19:40:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:10.851390 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1310f-8ebe-43fe-89dc-f252d14cb158 service swift] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:10.863278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1310f-8ebe-43fe-89dc-f252d14cb158 service swift] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:10.869836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9610-b41c-4b11-bda4-89674325bd5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c331b659da48549c4c91e659ff83ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:10.873359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9610-b41c-4b11-bda4-89674325bd5d service swift] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:10.873647 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9610-b41c-4b11-bda4-89674325bd5d service swift] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:10.873960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9610-b41c-4b11-bda4-89674325bd5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:10.887059 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d9610-b41c-4b11-bda4-89674325bd5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:10.888676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d9610-b41c-4b11-bda4-89674325bd5d service swift] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:10.897483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1380/2757] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 31 19:40:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:40:14.296804 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade58cf-5fae-4df6-9035-97ed7156488c None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:14.308554 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade58cf-5fae-4df6-9035-97ed7156488c None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:14.314098 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:14.314739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:14.315047 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:14.315350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] PATH_INFO: `/v3/users/486bedc24c084ce68c56928da3fa4c8b` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:14.316483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=486bedc24c084ce68c56928da3fa4c8b)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:14.318507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:14.532665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486bedc24c084ce68c56928da3fa4c8b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:14.626731 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486bedc24c084ce68c56928da3fa4c8b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:14.627385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486bedc24c084ce68c56928da3fa4c8b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:14.642430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486bedc24c084ce68c56928da3fa4c8b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:14.642430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-e62259f2-1593-4e60-a652-f285b0884b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486bedc24c084ce68c56928da3fa4c8b'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:14.654269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1378/2758] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:14 2022] DELETE /identity/v3/users/486bedc24c084ce68c56928da3fa4c8b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:14.907380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9610-b41c-4b11-bda4-89674325bd5d service swift] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:14.919497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9610-b41c-4b11-bda4-89674325bd5d service swift] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:14.976826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:14.977453 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:14.977760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:14.978037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] PATH_INFO: `/v3/projects/e9436da98d0341c4b3b8296c62464333` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:14.979283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9436da98d0341c4b3b8296c62464333)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:14.981290 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:15.147062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9436da98d0341c4b3b8296c62464333', 'request_id': 'req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:15.153370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9436da98d0341c4b3b8296c62464333', 'request_id': 'req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:15.247921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9436da98d0341c4b3b8296c62464333', 'request_id': 'req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:15.258824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] The token cache is being invalidate because project e9436da98d0341c4b3b8296c62464333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:15.259114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:15.259761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-221f3d00-d1fb-4e4e-aec4-a3a4748350b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:15.261340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1381/2759] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:14 2022] DELETE /identity/v3/projects/e9436da98d0341c4b3b8296c62464333 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:15.267664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf164-1053-4d22-8e89-fc60a4ddbb0f None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:15.267953 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf164-1053-4d22-8e89-fc60a4ddbb0f None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:15.268230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf164-1053-4d22-8e89-fc60a4ddbb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:15.288730 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-cfdaf164-1053-4d22-8e89-fc60a4ddbb0f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:15.296043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-cfdaf164-1053-4d22-8e89-fc60a4ddbb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:15.353339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1379/2760] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:15.361513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b814ed9-ebfb-4ee8-a1d4-0afc93af3f7b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:15.361826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b814ed9-ebfb-4ee8-a1d4-0afc93af3f7b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:15.362128 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b814ed9-ebfb-4ee8-a1d4-0afc93af3f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:15.382281 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-8b814ed9-ebfb-4ee8-a1d4-0afc93af3f7b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:15.389158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8b814ed9-ebfb-4ee8-a1d4-0afc93af3f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:15.392015 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1382/2761] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:15.396162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf164-1053-4d22-8e89-fc60a4ddbb0f None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:15.405727 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf164-1053-4d22-8e89-fc60a4ddbb0f None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:15.410155 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1f404-24d6-434b-9206-d00b65c569d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:15.410741 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1f404-24d6-434b-9206-d00b65c569d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:15.411019 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1f404-24d6-434b-9206-d00b65c569d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:15.411285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1f404-24d6-434b-9206-d00b65c569d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:15.411916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1f404-24d6-434b-9206-d00b65c569d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:40:15.412216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1f404-24d6-434b-9206-d00b65c569d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:15.413802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1f404-24d6-434b-9206-d00b65c569d1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:15.425566 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1380/2762] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:40:15.432319 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b814ed9-ebfb-4ee8-a1d4-0afc93af3f7b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:15.442135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b814ed9-ebfb-4ee8-a1d4-0afc93af3f7b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:15.446870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a241b8-c70b-4817-a580-ac9c854d55b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:15.447444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a241b8-c70b-4817-a580-ac9c854d55b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:15.447723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a241b8-c70b-4817-a580-ac9c854d55b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:15.448040 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a241b8-c70b-4817-a580-ac9c854d55b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:15.448685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a241b8-c70b-4817-a580-ac9c854d55b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:15.451355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a241b8-c70b-4817-a580-ac9c854d55b3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:15.564878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1383/2763] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:40:15 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:15.569038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1f404-24d6-434b-9206-d00b65c569d1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:15.579758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1f404-24d6-434b-9206-d00b65c569d1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:15.627790 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:15.636837 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efd743-e99f-47e5-9c53-43eba795cde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:15.637535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efd743-e99f-47e5-9c53-43eba795cde9 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:15.640267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efd743-e99f-47e5-9c53-43eba795cde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:15.640267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efd743-e99f-47e5-9c53-43eba795cde9 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:15.640267 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efd743-e99f-47e5-9c53-43eba795cde9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:15.641403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efd743-e99f-47e5-9c53-43eba795cde9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:15.722614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1381/2764] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:40:15 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:40:15.727041 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a241b8-c70b-4817-a580-ac9c854d55b3 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:15.738376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a241b8-c70b-4817-a580-ac9c854d55b3 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:15.742593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced88f6-f4fc-443a-8d12-888a0ef0060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:15.743189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced88f6-f4fc-443a-8d12-888a0ef0060a admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:15.743466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced88f6-f4fc-443a-8d12-888a0ef0060a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:15.743737 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced88f6-f4fc-443a-8d12-888a0ef0060a admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:15.744427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced88f6-f4fc-443a-8d12-888a0ef0060a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:15.746056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced88f6-f4fc-443a-8d12-888a0ef0060a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:15.756811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1384/2765] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:15.760836 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efd743-e99f-47e5-9c53-43eba795cde9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:15.771254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efd743-e99f-47e5-9c53-43eba795cde9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:15.776197 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc651a-269d-40fd-b24e-c7a9f88089a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:15.776801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc651a-269d-40fd-b24e-c7a9f88089a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:15.777110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc651a-269d-40fd-b24e-c7a9f88089a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:15.777383 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc651a-269d-40fd-b24e-c7a9f88089a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:15.778077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc651a-269d-40fd-b24e-c7a9f88089a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:15.779651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc651a-269d-40fd-b24e-c7a9f88089a1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:15.791047 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1382/2766] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:40:15.796269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced88f6-f4fc-443a-8d12-888a0ef0060a admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:15.806585 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced88f6-f4fc-443a-8d12-888a0ef0060a admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:15.812224 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dd50a-3ae6-40b4-81a2-bb9b813660d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:15.812918 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd50a-3ae6-40b4-81a2-bb9b813660d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:15.813199 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd50a-3ae6-40b4-81a2-bb9b813660d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:15.813476 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd50a-3ae6-40b4-81a2-bb9b813660d7 admin admin] PATH_INFO: `/v3/projects/3c99262d9f9441948e19fcff85619f4a/users/224a7368c20646c787b16bf452226905/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:15.829061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dd50a-3ae6-40b4-81a2-bb9b813660d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c99262d9f9441948e19fcff85619f4a, user_id=224a7368c20646c787b16bf452226905, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:15.831867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dd50a-3ae6-40b4-81a2-bb9b813660d7 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:15.957328 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1385/2767] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:40:15 2022] PUT /identity/v3/projects/3c99262d9f9441948e19fcff85619f4a/users/224a7368c20646c787b16bf452226905/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:15.968523 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b00c-ae32-453c-9b0f-19cea13ae9c7 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:15.968815 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b00c-ae32-453c-9b0f-19cea13ae9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:15.969112 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b00c-ae32-453c-9b0f-19cea13ae9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:15.998168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-6dc9b00c-ae32-453c-9b0f-19cea13ae9c7 None None] MFA Rules not processed for user `224a7368c20646c787b16bf452226905`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:15.999321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6dc9b00c-ae32-453c-9b0f-19cea13ae9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:16.063284 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1383/2768] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:40:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:16.076504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dd50a-3ae6-40b4-81a2-bb9b813660d7 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:16.078271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-bd4dd50a-3ae6-40b4-81a2-bb9b813660d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:16.093188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:16.139592 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dd50a-3ae6-40b4-81a2-bb9b813660d7 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:16.143353 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcddb18-5d08-4e35-8f9f-8998b0d425ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:16.143952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcddb18-5d08-4e35-8f9f-8998b0d425ff service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:16.144236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcddb18-5d08-4e35-8f9f-8998b0d425ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:16.144536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcddb18-5d08-4e35-8f9f-8998b0d425ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:16.153621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcddb18-5d08-4e35-8f9f-8998b0d425ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:16.155091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcddb18-5d08-4e35-8f9f-8998b0d425ff service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:16.164628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1386/2769] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:26.064372 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:26.196456 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=20 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:58.070436 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9b00c-ae32-453c-9b0f-19cea13ae9c7 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:58.132551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9b00c-ae32-453c-9b0f-19cea13ae9c7 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:58.137058 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:58.137691 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:58.137992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:58.138265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] PATH_INFO: `/v3/users/224a7368c20646c787b16bf452226905` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:58.139384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=224a7368c20646c787b16bf452226905)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:58.141283 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:58.353401 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224a7368c20646c787b16bf452226905'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:58.426035 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224a7368c20646c787b16bf452226905'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:58.426706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224a7368c20646c787b16bf452226905'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:58.446541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224a7368c20646c787b16bf452226905'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:58.447255 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224a7368c20646c787b16bf452226905'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:58.459403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1384/2770] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:40:58 2022] DELETE /identity/v3/users/224a7368c20646c787b16bf452226905 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:40:58.463943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fed93-2c88-4e0e-a39f-129d3cc2106f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:58.464483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fed93-2c88-4e0e-a39f-129d3cc2106f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:58.464483 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fed93-2c88-4e0e-a39f-129d3cc2106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:58.482919 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ab3fed93-2c88-4e0e-a39f-129d3cc2106f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:40:58.484120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ab3fed93-2c88-4e0e-a39f-129d3cc2106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:58.542760 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1387/2771] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:40:58.553208 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:58.554725 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:58.611011 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a40890-3a6e-4f00-873d-947042d6cbfc admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:58.615075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6d77-922e-4ea0-8cba-f584db4449c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:58.615682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6d77-922e-4ea0-8cba-f584db4449c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:58.615967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6d77-922e-4ea0-8cba-f584db4449c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:58.616251 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6d77-922e-4ea0-8cba-f584db4449c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:58.625636 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6d77-922e-4ea0-8cba-f584db4449c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:58.627095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6d77-922e-4ea0-8cba-f584db4449c5 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:58.637043 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1385/2772] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:40:59.066991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fed93-2c88-4e0e-a39f-129d3cc2106f None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:40:59.068505 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ab3fed93-2c88-4e0e-a39f-129d3cc2106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:40:59.081980 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fed93-2c88-4e0e-a39f-129d3cc2106f None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:40:59.086666 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:40:59.087659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:40:59.087941 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:40:59.088215 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] PATH_INFO: `/v3/projects/3c99262d9f9441948e19fcff85619f4a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:40:59.089406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c99262d9f9441948e19fcff85619f4a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:40:59.091360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:40:59.210820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c99262d9f9441948e19fcff85619f4a', 'request_id': 'req-d06b5f57-16cb-490b-a31c-70dd984d8738'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:59.216955 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c99262d9f9441948e19fcff85619f4a', 'request_id': 'req-d06b5f57-16cb-490b-a31c-70dd984d8738'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:59.306396 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c99262d9f9441948e19fcff85619f4a', 'request_id': 'req-d06b5f57-16cb-490b-a31c-70dd984d8738'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:59.317276 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] The token cache is being invalidate because project 3c99262d9f9441948e19fcff85619f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:40:59.317566 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:59.318236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:40:59.319744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1388/2773] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:40:59 2022] DELETE /identity/v3/projects/3c99262d9f9441948e19fcff85619f4a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:41:08.632801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:09.314178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:43.319600 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01652fb-5a81-476a-a286-7f97791d9ce9 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:41:43.320177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01652fb-5a81-476a-a286-7f97791d9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:41:43.320177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01652fb-5a81-476a-a286-7f97791d9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:41:43.340080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c01652fb-5a81-476a-a286-7f97791d9ce9 None None] MFA Rules not processed for user `827f9448c84b4a74ac4c64eb3cd57ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:41:43.341211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c01652fb-5a81-476a-a286-7f97791d9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:41:43.398007 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1386/2774] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:41:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:41:53.390776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=25 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:03.601366 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:03.603490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:03.679828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5f57-16cb-490b-a31c-70dd984d8738 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:03.685551 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8df795-5912-493d-97bd-16709f29e59b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:03.686261 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df795-5912-493d-97bd-16709f29e59b service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:03.686545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df795-5912-493d-97bd-16709f29e59b service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:03.686825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8df795-5912-493d-97bd-16709f29e59b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:03.688602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1b8df795-5912-493d-97bd-16709f29e59b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:03.701118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8df795-5912-493d-97bd-16709f29e59b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:03.702653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8df795-5912-493d-97bd-16709f29e59b service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:03.714101 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1389/2775] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:42:13.708925 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=34 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:17.166770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01652fb-5a81-476a-a286-7f97791d9ce9 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:42:17.168159 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c01652fb-5a81-476a-a286-7f97791d9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:17.237870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01652fb-5a81-476a-a286-7f97791d9ce9 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:42:17.242848 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4ded6-8e58-42f4-b905-15fc1d7b34f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:42:17.243456 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ded6-8e58-42f4-b905-15fc1d7b34f0 service placement] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:42:17.243738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ded6-8e58-42f4-b905-15fc1d7b34f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:42:17.244014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ded6-8e58-42f4-b905-15fc1d7b34f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:42:17.245760 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-85a4ded6-8e58-42f4-b905-15fc1d7b34f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:42:17.257736 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4ded6-8e58-42f4-b905-15fc1d7b34f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:42:17.259319 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4ded6-8e58-42f4-b905-15fc1d7b34f0 service placement] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:42:17.269162 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1387/2776] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:42:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:42:27.264959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=32 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:17.338292 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8df795-5912-493d-97bd-16709f29e59b service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:43:17.344320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1b8df795-5912-493d-97bd-16709f29e59b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:43:17.353486 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8df795-5912-493d-97bd-16709f29e59b service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:43:17.360944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5181241-f57e-4ae7-9636-279605f45a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:43:17.361597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5181241-f57e-4ae7-9636-279605f45a7b service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:43:17.361895 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5181241-f57e-4ae7-9636-279605f45a7b service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:43:17.362168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5181241-f57e-4ae7-9636-279605f45a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:43:17.364146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a5181241-f57e-4ae7-9636-279605f45a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:43:17.375435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5181241-f57e-4ae7-9636-279605f45a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:43:17.378564 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5181241-f57e-4ae7-9636-279605f45a7b service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:43:17.386179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1390/2777] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:43:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:43:22.590825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4ded6-8e58-42f4-b905-15fc1d7b34f0 service placement] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:43:22.592235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-85a4ded6-8e58-42f4-b905-15fc1d7b34f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:43:22.649244 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4ded6-8e58-42f4-b905-15fc1d7b34f0 service placement] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:43:22.653005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46814f3f-6f54-4bb8-904b-311602fec64b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:43:22.653617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46814f3f-6f54-4bb8-904b-311602fec64b service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:43:22.653930 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46814f3f-6f54-4bb8-904b-311602fec64b service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:43:22.654212 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46814f3f-6f54-4bb8-904b-311602fec64b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:43:22.656017 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-46814f3f-6f54-4bb8-904b-311602fec64b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:43:22.670005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46814f3f-6f54-4bb8-904b-311602fec64b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:43:22.671419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46814f3f-6f54-4bb8-904b-311602fec64b service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:43:22.682947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1388/2778] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:43:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:43:25.592012 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5181241-f57e-4ae7-9636-279605f45a7b service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:43:25.593512 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a5181241-f57e-4ae7-9636-279605f45a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:43:25.650434 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5181241-f57e-4ae7-9636-279605f45a7b service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:43:25.653991 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe9287-512a-4217-9579-fec5ddac699f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:43:25.654589 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe9287-512a-4217-9579-fec5ddac699f service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:43:25.654866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe9287-512a-4217-9579-fec5ddac699f service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:43:25.655136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe9287-512a-4217-9579-fec5ddac699f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:43:25.656842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-87fe9287-512a-4217-9579-fec5ddac699f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:43:25.670849 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe9287-512a-4217-9579-fec5ddac699f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:43:25.672263 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe9287-512a-4217-9579-fec5ddac699f service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:43:25.683671 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1391/2779] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:43:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:43:32.677507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=26 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:33.685591 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950b3f1-ca11-432c-96f8-89e400ad4c4e None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:43:33.689936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950b3f1-ca11-432c-96f8-89e400ad4c4e None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:43:33.689936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950b3f1-ca11-432c-96f8-89e400ad4c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:43:33.708315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4950b3f1-ca11-432c-96f8-89e400ad4c4e None None] MFA Rules not processed for user `827f9448c84b4a74ac4c64eb3cd57ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:43:33.709534 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4950b3f1-ca11-432c-96f8-89e400ad4c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:43:33.718057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1389/2780] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:43:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:43:35.678908 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=32 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:43.700850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:13.798347 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe9287-512a-4217-9579-fec5ddac699f service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:44:13.799765 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-87fe9287-512a-4217-9579-fec5ddac699f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:44:13.810735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe9287-512a-4217-9579-fec5ddac699f service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:44:13.814484 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3449cbe-8c3f-4675-95c1-5b745c1671ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:44:13.815089 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449cbe-8c3f-4675-95c1-5b745c1671ce service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:44:13.815364 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449cbe-8c3f-4675-95c1-5b745c1671ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:44:13.815635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449cbe-8c3f-4675-95c1-5b745c1671ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:44:13.817369 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a3449cbe-8c3f-4675-95c1-5b745c1671ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:44:13.828075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3449cbe-8c3f-4675-95c1-5b745c1671ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:44:13.829516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3449cbe-8c3f-4675-95c1-5b745c1671ce service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:44:13.837529 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1392/2781] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:44:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:44:23.834166 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=6 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:15.812379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950b3f1-ca11-432c-96f8-89e400ad4c4e None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:15.839025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950b3f1-ca11-432c-96f8-89e400ad4c4e None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:15.847419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1531-c8ae-405a-8356-5b7ed1753a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:15.847419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1531-c8ae-405a-8356-5b7ed1753a7b service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:15.847419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1531-c8ae-405a-8356-5b7ed1753a7b service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:15.847419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1531-c8ae-405a-8356-5b7ed1753a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:15.847989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-732b1531-c8ae-405a-8356-5b7ed1753a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:15.861160 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b1531-c8ae-405a-8356-5b7ed1753a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:15.862911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b1531-c8ae-405a-8356-5b7ed1753a7b service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:15.875009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1390/2782] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:45:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:45:22.622469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3449cbe-8c3f-4675-95c1-5b745c1671ce service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:22.632164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3449cbe-8c3f-4675-95c1-5b745c1671ce service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:22.635915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef2bb6-39af-4bbe-a750-5e142e45fb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:22.636501 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef2bb6-39af-4bbe-a750-5e142e45fb00 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:22.636778 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef2bb6-39af-4bbe-a750-5e142e45fb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:22.637550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef2bb6-39af-4bbe-a750-5e142e45fb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:22.639287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b1ef2bb6-39af-4bbe-a750-5e142e45fb00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:22.703447 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef2bb6-39af-4bbe-a750-5e142e45fb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:22.704915 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef2bb6-39af-4bbe-a750-5e142e45fb00 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:22.714741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1393/2783] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:45:25.875712 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=6 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:26.399351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1531-c8ae-405a-8356-5b7ed1753a7b service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:26.404248 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-732b1531-c8ae-405a-8356-5b7ed1753a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:26.415718 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1531-c8ae-405a-8356-5b7ed1753a7b service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:26.420789 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d055f6-7310-4e79-a929-0eeb543d9e90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:26.421393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d055f6-7310-4e79-a929-0eeb543d9e90 service placement] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:26.421690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d055f6-7310-4e79-a929-0eeb543d9e90 service placement] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:26.422563 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d055f6-7310-4e79-a929-0eeb543d9e90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:26.423889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-51d055f6-7310-4e79-a929-0eeb543d9e90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:26.435839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d055f6-7310-4e79-a929-0eeb543d9e90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:26.437421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d055f6-7310-4e79-a929-0eeb543d9e90 service placement] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:26.447276 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1391/2784] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:45:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:45:26.545929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef2bb6-39af-4bbe-a750-5e142e45fb00 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:26.547550 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-b1ef2bb6-39af-4bbe-a750-5e142e45fb00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:26.562470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef2bb6-39af-4bbe-a750-5e142e45fb00 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:26.567130 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:26.569770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:26.569770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:26.569770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] PATH_INFO: `/v3/users/827f9448c84b4a74ac4c64eb3cd57ad7` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:26.569770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=827f9448c84b4a74ac4c64eb3cd57ad7)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:26.571351 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:26.794010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827f9448c84b4a74ac4c64eb3cd57ad7'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:26.794660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827f9448c84b4a74ac4c64eb3cd57ad7'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:26.795279 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827f9448c84b4a74ac4c64eb3cd57ad7'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:26.854003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827f9448c84b4a74ac4c64eb3cd57ad7'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:26.867218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-32a1c805-d6c8-4b70-bdaa-09365497d5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827f9448c84b4a74ac4c64eb3cd57ad7'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:26.880388 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1394/2785] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:45:26 2022] DELETE /identity/v3/users/827f9448c84b4a74ac4c64eb3cd57ad7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:27.139602 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d055f6-7310-4e79-a929-0eeb543d9e90 service placement] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:27.151306 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d055f6-7310-4e79-a929-0eeb543d9e90 service placement] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:27.210876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:27.211688 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:27.211826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:27.212052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] PATH_INFO: `/v3/projects/78313bf556db4dd9b546889fc668228e` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:27.213393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=78313bf556db4dd9b546889fc668228e)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:27.215373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:27.334756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78313bf556db4dd9b546889fc668228e', 'request_id': 'req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:27.340872 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78313bf556db4dd9b546889fc668228e', 'request_id': 'req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:27.430943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78313bf556db4dd9b546889fc668228e', 'request_id': 'req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:27.441786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] The token cache is being invalidate because project 78313bf556db4dd9b546889fc668228e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:45:27.442075 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:27.442694 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-00a2ad53-91b2-4f2b-840c-6538e40b0dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:27.444177 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1392/2786] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:45:27 2022] DELETE /identity/v3/projects/78313bf556db4dd9b546889fc668228e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:45:27.449286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbb41d-a82c-4f3b-bce4-bb668cdb0ba5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:27.449577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbb41d-a82c-4f3b-bce4-bb668cdb0ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:27.449885 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbb41d-a82c-4f3b-bce4-bb668cdb0ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:27.469873 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-51cbb41d-a82c-4f3b-bce4-bb668cdb0ba5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:45:27.471066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-51cbb41d-a82c-4f3b-bce4-bb668cdb0ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:27.528538 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1395/2787] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:45:27.537053 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365155-7057-4864-b5f0-09ae30835178 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:27.537339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365155-7057-4864-b5f0-09ae30835178 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:27.537614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365155-7057-4864-b5f0-09ae30835178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:27.558150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ab365155-7057-4864-b5f0-09ae30835178 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:45:27.559343 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ab365155-7057-4864-b5f0-09ae30835178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:27.567259 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1393/2788] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:45:27.571444 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbb41d-a82c-4f3b-bce4-bb668cdb0ba5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:27.581096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbb41d-a82c-4f3b-bce4-bb668cdb0ba5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:27.585557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d4664-4c5a-47c8-9fac-c248e078d8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:27.586189 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d4664-4c5a-47c8-9fac-c248e078d8ec admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:27.586470 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d4664-4c5a-47c8-9fac-c248e078d8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:27.586749 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d4664-4c5a-47c8-9fac-c248e078d8ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:27.587397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d4664-4c5a-47c8-9fac-c248e078d8ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:45:27.587704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d4664-4c5a-47c8-9fac-c248e078d8ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:27.589313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d4664-4c5a-47c8-9fac-c248e078d8ec admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:27.590811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:27.601710 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1396/2789] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:45:27.606019 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab365155-7057-4864-b5f0-09ae30835178 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:27.615854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab365155-7057-4864-b5f0-09ae30835178 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:27.620926 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82b1be-92e8-4bd7-9938-552d6de5b90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:27.621514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82b1be-92e8-4bd7-9938-552d6de5b90a admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:27.621823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82b1be-92e8-4bd7-9938-552d6de5b90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:27.622097 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82b1be-92e8-4bd7-9938-552d6de5b90a admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:27.622719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82b1be-92e8-4bd7-9938-552d6de5b90a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:27.624692 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82b1be-92e8-4bd7-9938-552d6de5b90a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:27.701951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1394/2790] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:45:27 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:45:27.706002 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d4664-4c5a-47c8-9fac-c248e078d8ec admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:27.716207 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d4664-4c5a-47c8-9fac-c248e078d8ec admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:27.772014 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88765886-048d-47a0-a373-8b513715ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:27.772607 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88765886-048d-47a0-a373-8b513715ccc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:27.772886 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88765886-048d-47a0-a373-8b513715ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:27.773164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88765886-048d-47a0-a373-8b513715ccc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:27.773826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88765886-048d-47a0-a373-8b513715ccc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:27.775729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88765886-048d-47a0-a373-8b513715ccc9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:27.865815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1397/2791] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:45:27 2022] POST /identity/v3/users => generated 279 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:45:27.870202 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82b1be-92e8-4bd7-9938-552d6de5b90a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:27.880633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82b1be-92e8-4bd7-9938-552d6de5b90a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:27.885391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55627f9-618c-4aa8-a857-d1cb9df0ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:27.886027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55627f9-618c-4aa8-a857-d1cb9df0ad3e admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:27.886313 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55627f9-618c-4aa8-a857-d1cb9df0ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:27.886590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55627f9-618c-4aa8-a857-d1cb9df0ad3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:27.887239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55627f9-618c-4aa8-a857-d1cb9df0ad3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:27.889340 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55627f9-618c-4aa8-a857-d1cb9df0ad3e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:27.899156 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1395/2792] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:45:27.903090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88765886-048d-47a0-a373-8b513715ccc9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:27.913870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88765886-048d-47a0-a373-8b513715ccc9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:27.918577 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822809b-93e5-416d-a502-b50ce8832288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:27.919185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822809b-93e5-416d-a502-b50ce8832288 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:27.919487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822809b-93e5-416d-a502-b50ce8832288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:27.919758 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822809b-93e5-416d-a502-b50ce8832288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:27.920431 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822809b-93e5-416d-a502-b50ce8832288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:27.922063 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822809b-93e5-416d-a502-b50ce8832288 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:27.932630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1398/2793] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:45:27.936842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55627f9-618c-4aa8-a857-d1cb9df0ad3e admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:27.946646 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55627f9-618c-4aa8-a857-d1cb9df0ad3e admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:27.951722 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec85777-b694-46a0-a8ac-bd3f85f399e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:27.952413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec85777-b694-46a0-a8ac-bd3f85f399e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:27.952644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec85777-b694-46a0-a8ac-bd3f85f399e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:27.952923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec85777-b694-46a0-a8ac-bd3f85f399e0 admin admin] PATH_INFO: `/v3/projects/bc07453f66754ee7904d0b72186925d5/users/5424927ec71c41a9a7f385250e279d96/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:27.967773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec85777-b694-46a0-a8ac-bd3f85f399e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc07453f66754ee7904d0b72186925d5, user_id=5424927ec71c41a9a7f385250e279d96, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:27.970470 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec85777-b694-46a0-a8ac-bd3f85f399e0 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:28.083476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1396/2794] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:45:27 2022] PUT /identity/v3/projects/bc07453f66754ee7904d0b72186925d5/users/5424927ec71c41a9a7f385250e279d96/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:28.094867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232fd38-7d95-4b85-95c9-c91b8dc9c381 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:28.095217 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232fd38-7d95-4b85-95c9-c91b8dc9c381 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:28.095432 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232fd38-7d95-4b85-95c9-c91b8dc9c381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:28.123675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-7232fd38-7d95-4b85-95c9-c91b8dc9c381 None None] MFA Rules not processed for user `5424927ec71c41a9a7f385250e279d96`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:45:28.124910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7232fd38-7d95-4b85-95c9-c91b8dc9c381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:28.187115 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1399/2795] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:45:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:45:28.191814 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec85777-b694-46a0-a8ac-bd3f85f399e0 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:28.206186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:28.253931 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec85777-b694-46a0-a8ac-bd3f85f399e0 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:28.258482 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6cfa7-358d-49a5-a617-ad041e2f198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:28.259080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6cfa7-358d-49a5-a617-ad041e2f198a admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:28.259359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6cfa7-358d-49a5-a617-ad041e2f198a admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:28.259632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6cfa7-358d-49a5-a617-ad041e2f198a admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:28.260271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6cfa7-358d-49a5-a617-ad041e2f198a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:28.262183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6cfa7-358d-49a5-a617-ad041e2f198a admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:28.432864 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1397/2796] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:45:28 2022] POST /identity/v3/projects => generated 357 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:45:28.437429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232fd38-7d95-4b85-95c9-c91b8dc9c381 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:28.447966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232fd38-7d95-4b85-95c9-c91b8dc9c381 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:28.503994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70de7c8-2bca-4961-9a8e-b3d4bb39b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:28.504535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70de7c8-2bca-4961-9a8e-b3d4bb39b6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:28.504809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70de7c8-2bca-4961-9a8e-b3d4bb39b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:28.505079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70de7c8-2bca-4961-9a8e-b3d4bb39b6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:28.505809 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70de7c8-2bca-4961-9a8e-b3d4bb39b6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:28.507790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70de7c8-2bca-4961-9a8e-b3d4bb39b6d0 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:28.516763 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:28.632058 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1400/2797] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:45:28 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:45:28.638476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6cfa7-358d-49a5-a617-ad041e2f198a admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:28.651069 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6cfa7-358d-49a5-a617-ad041e2f198a admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:28.660643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953d098-b24b-4d46-af23-5b0cd10fa2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:28.661327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953d098-b24b-4d46-af23-5b0cd10fa2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:28.661617 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953d098-b24b-4d46-af23-5b0cd10fa2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:28.661972 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953d098-b24b-4d46-af23-5b0cd10fa2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:28.662637 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953d098-b24b-4d46-af23-5b0cd10fa2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:28.664205 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953d098-b24b-4d46-af23-5b0cd10fa2d3 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:28.679733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1398/2798] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:45:28.683820 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70de7c8-2bca-4961-9a8e-b3d4bb39b6d0 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:28.695090 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70de7c8-2bca-4961-9a8e-b3d4bb39b6d0 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:28.700270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6b8a9-d22b-45b2-9bcd-c1e524af54b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:28.701127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6b8a9-d22b-45b2-9bcd-c1e524af54b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:28.701508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6b8a9-d22b-45b2-9bcd-c1e524af54b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:28.701922 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6b8a9-d22b-45b2-9bcd-c1e524af54b3 admin admin] PATH_INFO: `/v3/projects/f57fab1df6d24c829d1328c794417153/users/9e9e3d80c33f4fbe817dbf791c92cbb4/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:28.725005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6b8a9-d22b-45b2-9bcd-c1e524af54b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57fab1df6d24c829d1328c794417153, user_id=9e9e3d80c33f4fbe817dbf791c92cbb4, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:28.728458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6b8a9-d22b-45b2-9bcd-c1e524af54b3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:28.801457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1401/2799] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:45:28 2022] PUT /identity/v3/projects/f57fab1df6d24c829d1328c794417153/users/9e9e3d80c33f4fbe817dbf791c92cbb4/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:45:28.805521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953d098-b24b-4d46-af23-5b0cd10fa2d3 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:28.815868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953d098-b24b-4d46-af23-5b0cd10fa2d3 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:28.877365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1b6a-51a7-4edb-b00c-c420969b5120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:28.878019 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1b6a-51a7-4edb-b00c-c420969b5120 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:28.878299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1b6a-51a7-4edb-b00c-c420969b5120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:28.878575 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1b6a-51a7-4edb-b00c-c420969b5120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:28.879222 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab1b6a-51a7-4edb-b00c-c420969b5120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:28.880796 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab1b6a-51a7-4edb-b00c-c420969b5120 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:28.891052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1399/2800] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:45:28.895320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6b8a9-d22b-45b2-9bcd-c1e524af54b3 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:28.906557 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6b8a9-d22b-45b2-9bcd-c1e524af54b3 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:28.911329 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b318f4-067d-4f4e-bb22-cf4d5220fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:28.912062 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b318f4-067d-4f4e-bb22-cf4d5220fc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:28.912339 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b318f4-067d-4f4e-bb22-cf4d5220fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:28.912613 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b318f4-067d-4f4e-bb22-cf4d5220fc94 admin admin] PATH_INFO: `/v3/projects/f57fab1df6d24c829d1328c794417153/users/9e9e3d80c33f4fbe817dbf791c92cbb4/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:28.915010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b318f4-067d-4f4e-bb22-cf4d5220fc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57fab1df6d24c829d1328c794417153, user_id=9e9e3d80c33f4fbe817dbf791c92cbb4, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:28.917769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b318f4-067d-4f4e-bb22-cf4d5220fc94 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:28.930687 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1402/2801] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:45:28 2022] PUT /identity/v3/projects/f57fab1df6d24c829d1328c794417153/users/9e9e3d80c33f4fbe817dbf791c92cbb4/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:28.940690 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa61c6e-4bf6-4449-aa3b-5f24afb88872 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:28.940988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa61c6e-4bf6-4449-aa3b-5f24afb88872 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:28.941269 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa61c6e-4bf6-4449-aa3b-5f24afb88872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:28.969296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-8aa61c6e-4bf6-4449-aa3b-5f24afb88872 None None] MFA Rules not processed for user `9e9e3d80c33f4fbe817dbf791c92cbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:45:28.970580 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-8aa61c6e-4bf6-4449-aa3b-5f24afb88872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:29.040965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1400/2802] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:45:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:45:29.053952 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b318f4-067d-4f4e-bb22-cf4d5220fc94 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:29.055572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e1b318f4-067d-4f4e-bb22-cf4d5220fc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:29.115485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b318f4-067d-4f4e-bb22-cf4d5220fc94 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:29.119456 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba73904-9573-47a7-b5d6-b7fa7f12ff2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:29.120057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73904-9573-47a7-b5d6-b7fa7f12ff2b service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:29.120335 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73904-9573-47a7-b5d6-b7fa7f12ff2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:29.120605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73904-9573-47a7-b5d6-b7fa7f12ff2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:29.129588 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba73904-9573-47a7-b5d6-b7fa7f12ff2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:29.131034 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba73904-9573-47a7-b5d6-b7fa7f12ff2b service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:29.140386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1403/2803] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:45:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:45:29.325157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa61c6e-4bf6-4449-aa3b-5f24afb88872 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:29.335683 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa61c6e-4bf6-4449-aa3b-5f24afb88872 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:29.339485 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93f750-2a26-48fb-8644-21727bf0af4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:29.340106 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93f750-2a26-48fb-8644-21727bf0af4a service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:29.340388 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93f750-2a26-48fb-8644-21727bf0af4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:29.340681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93f750-2a26-48fb-8644-21727bf0af4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:29.346389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:29.399134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93f750-2a26-48fb-8644-21727bf0af4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:29.400561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93f750-2a26-48fb-8644-21727bf0af4a service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:29.410094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1401/2804] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:45:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:45:39.136061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:39.425279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=24 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:49.378093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba73904-9573-47a7-b5d6-b7fa7f12ff2b service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:49.446009 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba73904-9573-47a7-b5d6-b7fa7f12ff2b service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:49.450700 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:49.451306 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:49.451587 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:49.451867 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] PATH_INFO: `/v3/users/5424927ec71c41a9a7f385250e279d96` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:49.453060 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5424927ec71c41a9a7f385250e279d96)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:49.455001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:49.625741 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5424927ec71c41a9a7f385250e279d96'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:49.626324 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5424927ec71c41a9a7f385250e279d96'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:49.626927 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5424927ec71c41a9a7f385250e279d96'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:49.688064 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5424927ec71c41a9a7f385250e279d96'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:49.701981 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5424927ec71c41a9a7f385250e279d96'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:49.714214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1404/2805] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:45:49 2022] DELETE /identity/v3/users/5424927ec71c41a9a7f385250e279d96 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:49.718767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd039f8-08ca-480a-a786-375b189c71fb None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:49.719261 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd039f8-08ca-480a-a786-375b189c71fb None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:49.719368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd039f8-08ca-480a-a786-375b189c71fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:49.739590 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-4bd039f8-08ca-480a-a786-375b189c71fb None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:45:49.741354 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4bd039f8-08ca-480a-a786-375b189c71fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:49.799438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1402/2806] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:45:49.809770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:49.811188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:49.868226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449480a8-074b-4e89-b9da-4bac501268ff admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:49.871964 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185b379-4979-4925-822a-937b057fd0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:49.872594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b379-4979-4925-822a-937b057fd0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:49.872894 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b379-4979-4925-822a-937b057fd0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:49.873165 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b379-4979-4925-822a-937b057fd0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:49.882174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185b379-4979-4925-822a-937b057fd0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:49.883523 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185b379-4979-4925-822a-937b057fd0e1 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:49.892597 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1405/2807] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:45:50.318612 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd039f8-08ca-480a-a786-375b189c71fb None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:50.320038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-4bd039f8-08ca-480a-a786-375b189c71fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:50.332776 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd039f8-08ca-480a-a786-375b189c71fb None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:50.338226 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:50.346024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:50.346024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:50.346024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] PATH_INFO: `/v3/projects/bc07453f66754ee7904d0b72186925d5` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:50.346024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc07453f66754ee7904d0b72186925d5)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:50.346024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:50.430150 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc07453f66754ee7904d0b72186925d5', 'request_id': 'req-9eda958e-311a-4d41-90f2-e081e1ed81cd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:50.436151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc07453f66754ee7904d0b72186925d5', 'request_id': 'req-9eda958e-311a-4d41-90f2-e081e1ed81cd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:50.508850 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc07453f66754ee7904d0b72186925d5', 'request_id': 'req-9eda958e-311a-4d41-90f2-e081e1ed81cd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:50.519496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] The token cache is being invalidate because project bc07453f66754ee7904d0b72186925d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:45:50.519756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:50.520394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:50.522494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1403/2808] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:45:50 2022] DELETE /identity/v3/projects/bc07453f66754ee7904d0b72186925d5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:50.526516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185b379-4979-4925-822a-937b057fd0e1 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:50.536342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185b379-4979-4925-822a-937b057fd0e1 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:50.555045 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:50.593286 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:50.593947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:50.594228 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:50.594503 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] PATH_INFO: `/v3/users/9e9e3d80c33f4fbe817dbf791c92cbb4` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:50.595626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9e3d80c33f4fbe817dbf791c92cbb4)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:50.597570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:50.837287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9e3d80c33f4fbe817dbf791c92cbb4'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:50.838113 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9e3d80c33f4fbe817dbf791c92cbb4'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:50.839000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9e3d80c33f4fbe817dbf791c92cbb4'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:50.914491 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9e3d80c33f4fbe817dbf791c92cbb4'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:50.928411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6e5cf306-3a40-439e-badb-915fce8ceae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9e3d80c33f4fbe817dbf791c92cbb4'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:50.940830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1406/2809] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:45:50 2022] DELETE /identity/v3/users/9e9e3d80c33f4fbe817dbf791c92cbb4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:51.350868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:51.352421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:51.368407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda958e-311a-4d41-90f2-e081e1ed81cd admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:51.424080 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:51.424721 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:51.425004 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:51.425281 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] PATH_INFO: `/v3/projects/f57fab1df6d24c829d1328c794417153` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:51.426438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57fab1df6d24c829d1328c794417153)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:51.428983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:51.522472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:51.539869 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57fab1df6d24c829d1328c794417153', 'request_id': 'req-407f9bb0-883c-4a73-af98-f837afd032a2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:51.546204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57fab1df6d24c829d1328c794417153', 'request_id': 'req-407f9bb0-883c-4a73-af98-f837afd032a2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:51.614285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57fab1df6d24c829d1328c794417153', 'request_id': 'req-407f9bb0-883c-4a73-af98-f837afd032a2'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:51.626846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] The token cache is being invalidate because project f57fab1df6d24c829d1328c794417153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:45:51.627138 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:51.628265 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-407f9bb0-883c-4a73-af98-f837afd032a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:51.629291 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1404/2810] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:45:51 2022] DELETE /identity/v3/projects/f57fab1df6d24c829d1328c794417153 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:51.634756 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408298de-c721-433c-a1d6-6a846ec0e724 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:51.635260 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408298de-c721-433c-a1d6-6a846ec0e724 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:51.635374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408298de-c721-433c-a1d6-6a846ec0e724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:51.654713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-408298de-c721-433c-a1d6-6a846ec0e724 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:45:51.655900 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-408298de-c721-433c-a1d6-6a846ec0e724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:51.713632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1407/2811] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:45:51.722795 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2090d-aebe-4912-86e4-a46bf2dae37a None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:51.723087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2090d-aebe-4912-86e4-a46bf2dae37a None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:51.723369 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2090d-aebe-4912-86e4-a46bf2dae37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:51.744610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-a7e2090d-aebe-4912-86e4-a46bf2dae37a None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:45:51.745866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-a7e2090d-aebe-4912-86e4-a46bf2dae37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:51.753753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1405/2812] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:45:51.758622 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408298de-c721-433c-a1d6-6a846ec0e724 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:51.768253 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408298de-c721-433c-a1d6-6a846ec0e724 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:51.772780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085ea44-0b0c-4112-9fb3-fc8d471886b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:51.773384 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085ea44-0b0c-4112-9fb3-fc8d471886b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:51.773683 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085ea44-0b0c-4112-9fb3-fc8d471886b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:51.773965 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085ea44-0b0c-4112-9fb3-fc8d471886b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:51.774611 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085ea44-0b0c-4112-9fb3-fc8d471886b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:45:51.774913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085ea44-0b0c-4112-9fb3-fc8d471886b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:51.776499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085ea44-0b0c-4112-9fb3-fc8d471886b1 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:51.788029 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1408/2813] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:45:51.792305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2090d-aebe-4912-86e4-a46bf2dae37a None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:51.801483 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2090d-aebe-4912-86e4-a46bf2dae37a None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:51.806716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036c744-3056-4f8f-85e0-d5227df2579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:51.807312 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036c744-3056-4f8f-85e0-d5227df2579d admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:51.807597 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036c744-3056-4f8f-85e0-d5227df2579d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:51.807880 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036c744-3056-4f8f-85e0-d5227df2579d admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:51.808629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036c744-3056-4f8f-85e0-d5227df2579d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:51.810568 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036c744-3056-4f8f-85e0-d5227df2579d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:51.964373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1406/2814] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:45:51 2022] POST /identity/v3/projects => generated 399 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:45:51.968553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085ea44-0b0c-4112-9fb3-fc8d471886b1 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:51.978985 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085ea44-0b0c-4112-9fb3-fc8d471886b1 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:52.005025 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:52.034528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaab261-406e-42ce-baf9-d5e2efa1f5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:52.035133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab261-406e-42ce-baf9-d5e2efa1f5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:52.035410 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab261-406e-42ce-baf9-d5e2efa1f5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:52.035682 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab261-406e-42ce-baf9-d5e2efa1f5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:52.036309 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaab261-406e-42ce-baf9-d5e2efa1f5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:52.038785 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaab261-406e-42ce-baf9-d5e2efa1f5b6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:52.123172 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1409/2815] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:45:51 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:45:52.127384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036c744-3056-4f8f-85e0-d5227df2579d admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:52.137959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036c744-3056-4f8f-85e0-d5227df2579d admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:52.142606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75357d4-09fa-4a0f-b5bd-8a0b09b1deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:52.143217 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75357d4-09fa-4a0f-b5bd-8a0b09b1deb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:52.143614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75357d4-09fa-4a0f-b5bd-8a0b09b1deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:52.143900 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75357d4-09fa-4a0f-b5bd-8a0b09b1deb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:52.144548 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75357d4-09fa-4a0f-b5bd-8a0b09b1deb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:52.146178 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75357d4-09fa-4a0f-b5bd-8a0b09b1deb1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:52.156423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1407/2816] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:45:52.160723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaab261-406e-42ce-baf9-d5e2efa1f5b6 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:52.171479 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaab261-406e-42ce-baf9-d5e2efa1f5b6 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:52.176123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b7b75-ae59-4aca-b1fd-4c9122e96991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:52.176713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b7b75-ae59-4aca-b1fd-4c9122e96991 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:52.176990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b7b75-ae59-4aca-b1fd-4c9122e96991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:52.177355 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b7b75-ae59-4aca-b1fd-4c9122e96991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:52.178680 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b7b75-ae59-4aca-b1fd-4c9122e96991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:52.180284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b7b75-ae59-4aca-b1fd-4c9122e96991 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:52.190726 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1410/2817] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:45:52.194826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75357d4-09fa-4a0f-b5bd-8a0b09b1deb1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:52.204744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75357d4-09fa-4a0f-b5bd-8a0b09b1deb1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:52.209901 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a89352-b3fe-4319-8279-c5beac3bbe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:52.210561 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a89352-b3fe-4319-8279-c5beac3bbe8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:52.210858 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a89352-b3fe-4319-8279-c5beac3bbe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:52.211134 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a89352-b3fe-4319-8279-c5beac3bbe8f admin admin] PATH_INFO: `/v3/projects/ea0024a47cb34aa7abdaa967bccee31f/users/2a98d78bbc3b4ba3b4ff8f9c3c614dc5/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:52.226389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a89352-b3fe-4319-8279-c5beac3bbe8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0024a47cb34aa7abdaa967bccee31f, user_id=2a98d78bbc3b4ba3b4ff8f9c3c614dc5, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:52.228969 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a89352-b3fe-4319-8279-c5beac3bbe8f admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:52.299599 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1408/2818] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:45:52 2022] PUT /identity/v3/projects/ea0024a47cb34aa7abdaa967bccee31f/users/2a98d78bbc3b4ba3b4ff8f9c3c614dc5/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:45:52.309826 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd93b9c-23f1-460d-a736-800198a448e2 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:52.310120 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd93b9c-23f1-460d-a736-800198a448e2 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:52.310395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd93b9c-23f1-460d-a736-800198a448e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:52.338278 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-ebd93b9c-23f1-460d-a736-800198a448e2 None None] MFA Rules not processed for user `2a98d78bbc3b4ba3b4ff8f9c3c614dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:45:52.339485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ebd93b9c-23f1-460d-a736-800198a448e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:52.403888 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1411/2819] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:45:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:45:52.408393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a89352-b3fe-4319-8279-c5beac3bbe8f admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:52.469734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a89352-b3fe-4319-8279-c5beac3bbe8f admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:52.474481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c4e87-2afe-4960-8aae-bab4d4bbf3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:52.475651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4e87-2afe-4960-8aae-bab4d4bbf3ec admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:52.475936 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4e87-2afe-4960-8aae-bab4d4bbf3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:52.476213 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4e87-2afe-4960-8aae-bab4d4bbf3ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:52.476923 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c4e87-2afe-4960-8aae-bab4d4bbf3ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:52.478814 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c4e87-2afe-4960-8aae-bab4d4bbf3ec admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:52.604728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1409/2820] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:45:52 2022] POST /identity/v3/projects => generated 401 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:45:52.608850 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd93b9c-23f1-460d-a736-800198a448e2 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:52.620471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd93b9c-23f1-460d-a736-800198a448e2 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:52.675488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd6403-a5df-4a29-ad0b-87c07a5259ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:52.676222 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6403-a5df-4a29-ad0b-87c07a5259ff admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:52.676360 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6403-a5df-4a29-ad0b-87c07a5259ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:52.676634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6403-a5df-4a29-ad0b-87c07a5259ff admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:52.677267 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd6403-a5df-4a29-ad0b-87c07a5259ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:52.679184 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd6403-a5df-4a29-ad0b-87c07a5259ff admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:52.797055 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1412/2821] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:45:52 2022] POST /identity/v3/users => generated 307 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:45:52.801088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c4e87-2afe-4960-8aae-bab4d4bbf3ec admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:52.811649 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c4e87-2afe-4960-8aae-bab4d4bbf3ec admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:52.816476 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a3fad-02d0-4658-8fb0-327aa302bfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:52.817095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3fad-02d0-4658-8fb0-327aa302bfec admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:52.817373 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3fad-02d0-4658-8fb0-327aa302bfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:52.817731 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3fad-02d0-4658-8fb0-327aa302bfec admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:52.818394 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a3fad-02d0-4658-8fb0-327aa302bfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:52.820546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a3fad-02d0-4658-8fb0-327aa302bfec admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:52.832103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1410/2822] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:45:52.836917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd6403-a5df-4a29-ad0b-87c07a5259ff admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:52.846731 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd6403-a5df-4a29-ad0b-87c07a5259ff admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:52.851496 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec89f8-70f9-4254-8468-b97ad6a2568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:52.852140 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec89f8-70f9-4254-8468-b97ad6a2568e admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:52.852419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec89f8-70f9-4254-8468-b97ad6a2568e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:52.852691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec89f8-70f9-4254-8468-b97ad6a2568e admin admin] PATH_INFO: `/v3/projects/7a911a746d374a67af61e6c65abe98bd/users/f165bad3e0a44b64a08ffb04c7c3a041/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:52.867289 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec89f8-70f9-4254-8468-b97ad6a2568e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a911a746d374a67af61e6c65abe98bd, user_id=f165bad3e0a44b64a08ffb04c7c3a041, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:52.869936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec89f8-70f9-4254-8468-b97ad6a2568e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:52.940201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1413/2823] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:45:52 2022] PUT /identity/v3/projects/7a911a746d374a67af61e6c65abe98bd/users/f165bad3e0a44b64a08ffb04c7c3a041/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:52.944705 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a3fad-02d0-4658-8fb0-327aa302bfec admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:52.954786 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a3fad-02d0-4658-8fb0-327aa302bfec admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:52.975686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:53.012826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e62b3e-9311-4099-ab43-836a5a403753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:53.013442 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e62b3e-9311-4099-ab43-836a5a403753 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:53.013751 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e62b3e-9311-4099-ab43-836a5a403753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:53.014030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e62b3e-9311-4099-ab43-836a5a403753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:53.014676 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e62b3e-9311-4099-ab43-836a5a403753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:53.016416 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e62b3e-9311-4099-ab43-836a5a403753 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:53.026139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1411/2824] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:45:53.030359 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec89f8-70f9-4254-8468-b97ad6a2568e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:53.035878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:53.041259 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec89f8-70f9-4254-8468-b97ad6a2568e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:53.045880 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cccf8-ef21-472a-9e80-312b10d98afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:53.046531 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cccf8-ef21-472a-9e80-312b10d98afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:53.046803 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cccf8-ef21-472a-9e80-312b10d98afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:53.047183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cccf8-ef21-472a-9e80-312b10d98afe admin admin] PATH_INFO: `/v3/projects/7a911a746d374a67af61e6c65abe98bd/users/f165bad3e0a44b64a08ffb04c7c3a041/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:53.049037 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cccf8-ef21-472a-9e80-312b10d98afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a911a746d374a67af61e6c65abe98bd, user_id=f165bad3e0a44b64a08ffb04c7c3a041, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:53.051676 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cccf8-ef21-472a-9e80-312b10d98afe admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:53.063507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1414/2825] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:45:53 2022] PUT /identity/v3/projects/7a911a746d374a67af61e6c65abe98bd/users/f165bad3e0a44b64a08ffb04c7c3a041/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:53.075320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb79e-9001-479f-93f2-52c700f6fa5b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:53.080596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb79e-9001-479f-93f2-52c700f6fa5b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:53.080596 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb79e-9001-479f-93f2-52c700f6fa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:53.102774 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b13bb79e-9001-479f-93f2-52c700f6fa5b None None] MFA Rules not processed for user `f165bad3e0a44b64a08ffb04c7c3a041`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:45:53.103996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b13bb79e-9001-479f-93f2-52c700f6fa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:53.172397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1412/2826] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:45:53 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:45:53.184213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cccf8-ef21-472a-9e80-312b10d98afe admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:53.185943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f87cccf8-ef21-472a-9e80-312b10d98afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:53.250649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cccf8-ef21-472a-9e80-312b10d98afe admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:53.254243 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74a52d-021a-4a75-a810-f7642fa2a2a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:53.254838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74a52d-021a-4a75-a810-f7642fa2a2a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:53.255118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74a52d-021a-4a75-a810-f7642fa2a2a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:53.255412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74a52d-021a-4a75-a810-f7642fa2a2a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:53.265413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74a52d-021a-4a75-a810-f7642fa2a2a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:53.266904 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74a52d-021a-4a75-a810-f7642fa2a2a1 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:53.276845 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1415/2827] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:45:53 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:45:53.472081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb79e-9001-479f-93f2-52c700f6fa5b None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:53.483216 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb79e-9001-479f-93f2-52c700f6fa5b None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:53.486839 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82063ec-fd0e-4587-887b-e91479dc5cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:53.487438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82063ec-fd0e-4587-887b-e91479dc5cff service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:53.487724 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82063ec-fd0e-4587-887b-e91479dc5cff service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:53.487995 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82063ec-fd0e-4587-887b-e91479dc5cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:53.546201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82063ec-fd0e-4587-887b-e91479dc5cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:53.547688 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82063ec-fd0e-4587-887b-e91479dc5cff service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:53.557473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1413/2828] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:45:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:45:58.580770 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74a52d-021a-4a75-a810-f7642fa2a2a1 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:58.683725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74a52d-021a-4a75-a810-f7642fa2a2a1 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:58.688252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:58.688870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:58.689147 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:58.689427 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] PATH_INFO: `/v3/users/2a98d78bbc3b4ba3b4ff8f9c3c614dc5` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:58.690575 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a98d78bbc3b4ba3b4ff8f9c3c614dc5)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:58.692485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:58.887340 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:58.889043 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a98d78bbc3b4ba3b4ff8f9c3c614dc5'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:58.889720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a98d78bbc3b4ba3b4ff8f9c3c614dc5'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:58.890326 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a98d78bbc3b4ba3b4ff8f9c3c614dc5'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:58.979661 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a98d78bbc3b4ba3b4ff8f9c3c614dc5'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:58.992469 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a98d78bbc3b4ba3b4ff8f9c3c614dc5'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:59.004257 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1416/2829] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:45:58 2022] DELETE /identity/v3/users/2a98d78bbc3b4ba3b4ff8f9c3c614dc5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:59.008808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ddf53-0fbe-4ba1-bdac-601da55968f1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:59.009357 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ddf53-0fbe-4ba1-bdac-601da55968f1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:59.009773 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ddf53-0fbe-4ba1-bdac-601da55968f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:59.061891 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ff0ddf53-0fbe-4ba1-bdac-601da55968f1 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:45:59.063128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ff0ddf53-0fbe-4ba1-bdac-601da55968f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:59.075583 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=100 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:59.122706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1414/2830] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:45:59.132481 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:59.133914 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:59.199413 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b4a6c-12af-4546-a21c-e508e663455e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:59.203025 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ad2aa-c52c-44f7-8203-4dd21609dac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:59.203630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ad2aa-c52c-44f7-8203-4dd21609dac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:59.203910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ad2aa-c52c-44f7-8203-4dd21609dac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:59.204183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ad2aa-c52c-44f7-8203-4dd21609dac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:59.213755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ad2aa-c52c-44f7-8203-4dd21609dac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:59.215176 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ad2aa-c52c-44f7-8203-4dd21609dac5 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:59.224477 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1417/2831] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:45:59.656541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ddf53-0fbe-4ba1-bdac-601da55968f1 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:59.660506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ff0ddf53-0fbe-4ba1-bdac-601da55968f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:45:59.670270 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ddf53-0fbe-4ba1-bdac-601da55968f1 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:59.675042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:59.675699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:59.675988 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:59.676266 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] PATH_INFO: `/v3/projects/ea0024a47cb34aa7abdaa967bccee31f` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:59.677400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0024a47cb34aa7abdaa967bccee31f)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:59.679346 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:45:59.791739 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0024a47cb34aa7abdaa967bccee31f', 'request_id': 'req-5febe01e-da5e-4775-bd82-8733313b4773'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:59.797921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0024a47cb34aa7abdaa967bccee31f', 'request_id': 'req-5febe01e-da5e-4775-bd82-8733313b4773'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:59.874552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0024a47cb34aa7abdaa967bccee31f', 'request_id': 'req-5febe01e-da5e-4775-bd82-8733313b4773'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:59.886038 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] The token cache is being invalidate because project ea0024a47cb34aa7abdaa967bccee31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:45:59.886326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:59.886941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:45:59.888412 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1415/2832] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:45:59 2022] DELETE /identity/v3/projects/ea0024a47cb34aa7abdaa967bccee31f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:45:59.892910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ad2aa-c52c-44f7-8203-4dd21609dac5 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:45:59.902875 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ad2aa-c52c-44f7-8203-4dd21609dac5 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:45:59.958302 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:45:59.958923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:45:59.959245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:45:59.959500 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] PATH_INFO: `/v3/users/f165bad3e0a44b64a08ffb04c7c3a041` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:45:59.960633 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f165bad3e0a44b64a08ffb04c7c3a041)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:45:59.962573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:00.176790 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f165bad3e0a44b64a08ffb04c7c3a041'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:00.177439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f165bad3e0a44b64a08ffb04c7c3a041'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:00.178666 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f165bad3e0a44b64a08ffb04c7c3a041'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:00.257223 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f165bad3e0a44b64a08ffb04c7c3a041'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:00.262155 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:00.270001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-e775f279-8f2e-4db2-bc02-637c3d583470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f165bad3e0a44b64a08ffb04c7c3a041'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:00.282284 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1418/2833] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:45:59 2022] DELETE /identity/v3/users/f165bad3e0a44b64a08ffb04c7c3a041 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:00.730651 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:00.734843 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:00.747794 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febe01e-da5e-4775-bd82-8733313b4773 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:00.804382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:00.804920 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:00.805200 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:00.805473 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] PATH_INFO: `/v3/projects/7a911a746d374a67af61e6c65abe98bd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:00.806614 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a911a746d374a67af61e6c65abe98bd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:00.808508 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:00.946218 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:00.949897 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a911a746d374a67af61e6c65abe98bd', 'request_id': 'req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:00.956067 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a911a746d374a67af61e6c65abe98bd', 'request_id': 'req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:01.069325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a911a746d374a67af61e6c65abe98bd', 'request_id': 'req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:01.079842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] The token cache is being invalidate because project 7a911a746d374a67af61e6c65abe98bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:46:01.080128 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:01.080749 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-65fa37b1-5fb3-4dd3-b80c-f38d8601bbdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:01.082366 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1416/2834] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:46:00 2022] DELETE /identity/v3/projects/7a911a746d374a67af61e6c65abe98bd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:01.087864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f518b-e495-4451-87fd-33f7afbf8de5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:01.088358 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f518b-e495-4451-87fd-33f7afbf8de5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:01.088455 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f518b-e495-4451-87fd-33f7afbf8de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:01.108195 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-378f518b-e495-4451-87fd-33f7afbf8de5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:01.110203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-378f518b-e495-4451-87fd-33f7afbf8de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:01.170235 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1419/2835] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:01.178057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bea9a0-7f0a-4159-b335-1bba34b16e89 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:01.178349 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bea9a0-7f0a-4159-b335-1bba34b16e89 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:01.178645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bea9a0-7f0a-4159-b335-1bba34b16e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:01.199072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-10bea9a0-7f0a-4159-b335-1bba34b16e89 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:01.200293 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-10bea9a0-7f0a-4159-b335-1bba34b16e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:01.208748 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1417/2836] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:01.213625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f518b-e495-4451-87fd-33f7afbf8de5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:01.223088 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f518b-e495-4451-87fd-33f7afbf8de5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:01.227553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aa7ed-2926-4ea5-93d6-3f0efaf53eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:01.228143 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aa7ed-2926-4ea5-93d6-3f0efaf53eff admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:01.228419 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aa7ed-2926-4ea5-93d6-3f0efaf53eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:01.228690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aa7ed-2926-4ea5-93d6-3f0efaf53eff admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:01.229330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835aa7ed-2926-4ea5-93d6-3f0efaf53eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:46:01.229630 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835aa7ed-2926-4ea5-93d6-3f0efaf53eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:01.231244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835aa7ed-2926-4ea5-93d6-3f0efaf53eff admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:01.243902 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1420/2837] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:46:01.248645 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bea9a0-7f0a-4159-b335-1bba34b16e89 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:01.258761 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bea9a0-7f0a-4159-b335-1bba34b16e89 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:01.263384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e546e-d35e-4cb8-a8be-661f1da6b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:01.263982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e546e-d35e-4cb8-a8be-661f1da6b64b admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:01.264258 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e546e-d35e-4cb8-a8be-661f1da6b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:01.264565 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e546e-d35e-4cb8-a8be-661f1da6b64b admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:01.265201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e546e-d35e-4cb8-a8be-661f1da6b64b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:01.267135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e546e-d35e-4cb8-a8be-661f1da6b64b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:01.357489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1418/2838] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:46:01 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:46:01.361556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aa7ed-2926-4ea5-93d6-3f0efaf53eff admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:01.372236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aa7ed-2926-4ea5-93d6-3f0efaf53eff admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:01.426236 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dac972-2a12-4b78-b29b-a234ca23d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:01.426833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dac972-2a12-4b78-b29b-a234ca23d8bc admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:01.427114 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dac972-2a12-4b78-b29b-a234ca23d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:01.427386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dac972-2a12-4b78-b29b-a234ca23d8bc admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:01.428508 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dac972-2a12-4b78-b29b-a234ca23d8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:01.430534 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dac972-2a12-4b78-b29b-a234ca23d8bc admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:01.522971 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1421/2839] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:46:01 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:46:01.527618 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e546e-d35e-4cb8-a8be-661f1da6b64b admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:01.538088 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e546e-d35e-4cb8-a8be-661f1da6b64b admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:01.542896 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d51c8-87d6-49b6-abed-1c0299f2dc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:01.543507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d51c8-87d6-49b6-abed-1c0299f2dc5c admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:01.543793 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d51c8-87d6-49b6-abed-1c0299f2dc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:01.544072 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d51c8-87d6-49b6-abed-1c0299f2dc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:01.544728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d51c8-87d6-49b6-abed-1c0299f2dc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:01.546375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d51c8-87d6-49b6-abed-1c0299f2dc5c admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:01.557540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1419/2840] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:01.561582 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dac972-2a12-4b78-b29b-a234ca23d8bc admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:01.572621 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dac972-2a12-4b78-b29b-a234ca23d8bc admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:01.577691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bbc0a-1d68-4aaf-bcab-0b50a484c828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:01.578298 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bbc0a-1d68-4aaf-bcab-0b50a484c828 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:01.578581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bbc0a-1d68-4aaf-bcab-0b50a484c828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:01.578859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bbc0a-1d68-4aaf-bcab-0b50a484c828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:01.579555 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bbc0a-1d68-4aaf-bcab-0b50a484c828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:01.581144 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bbc0a-1d68-4aaf-bcab-0b50a484c828 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:01.591921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1422/2841] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:01.595961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d51c8-87d6-49b6-abed-1c0299f2dc5c admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:01.606238 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d51c8-87d6-49b6-abed-1c0299f2dc5c admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:01.610876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774dc83-c514-462b-bc79-4d1473cf7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:01.611459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774dc83-c514-462b-bc79-4d1473cf7238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:01.611743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774dc83-c514-462b-bc79-4d1473cf7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:01.612022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774dc83-c514-462b-bc79-4d1473cf7238 admin admin] PATH_INFO: `/v3/projects/fce3448f44a44cecba1338c1d42f6a1e/users/4a59c6814d714e8a889052b99c6ea375/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:01.627620 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774dc83-c514-462b-bc79-4d1473cf7238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce3448f44a44cecba1338c1d42f6a1e, user_id=4a59c6814d714e8a889052b99c6ea375, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:01.630306 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774dc83-c514-462b-bc79-4d1473cf7238 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:01.740859 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1420/2842] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:46:01 2022] PUT /identity/v3/projects/fce3448f44a44cecba1338c1d42f6a1e/users/4a59c6814d714e8a889052b99c6ea375/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:01.752452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef0250-a5b9-49a3-b5d7-0d8bf79a00f3 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:01.752734 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef0250-a5b9-49a3-b5d7-0d8bf79a00f3 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:01.755426 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef0250-a5b9-49a3-b5d7-0d8bf79a00f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:01.780146 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-28ef0250-a5b9-49a3-b5d7-0d8bf79a00f3 None None] MFA Rules not processed for user `4a59c6814d714e8a889052b99c6ea375`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:01.781345 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-28ef0250-a5b9-49a3-b5d7-0d8bf79a00f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:01.819454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:01.845513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1423/2843] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:01.850131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774dc83-c514-462b-bc79-4d1473cf7238 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:01.911421 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774dc83-c514-462b-bc79-4d1473cf7238 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:01.916492 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f586e-9b4d-4dc9-8299-419f01bf1055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:01.917094 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f586e-9b4d-4dc9-8299-419f01bf1055 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:01.917379 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f586e-9b4d-4dc9-8299-419f01bf1055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:01.917656 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f586e-9b4d-4dc9-8299-419f01bf1055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:01.918315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f586e-9b4d-4dc9-8299-419f01bf1055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:01.920214 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f586e-9b4d-4dc9-8299-419f01bf1055 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:02.003844 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1421/2844] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:46:01 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:46:02.008162 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef0250-a5b9-49a3-b5d7-0d8bf79a00f3 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:02.018794 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef0250-a5b9-49a3-b5d7-0d8bf79a00f3 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:02.074239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1715827-0145-4fcb-b741-3f7b9d2beeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:02.074844 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715827-0145-4fcb-b741-3f7b9d2beeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:02.075124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715827-0145-4fcb-b741-3f7b9d2beeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:02.075425 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715827-0145-4fcb-b741-3f7b9d2beeb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:02.076067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1715827-0145-4fcb-b741-3f7b9d2beeb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:02.078000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1715827-0145-4fcb-b741-3f7b9d2beeb8 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:02.180077 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1424/2845] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:46:02 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:46:02.184324 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f586e-9b4d-4dc9-8299-419f01bf1055 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:02.194541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f586e-9b4d-4dc9-8299-419f01bf1055 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:02.199556 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193d85-0d2e-4f48-a0d5-ad67a8f453e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:02.200154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193d85-0d2e-4f48-a0d5-ad67a8f453e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:02.200430 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193d85-0d2e-4f48-a0d5-ad67a8f453e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:02.200699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193d85-0d2e-4f48-a0d5-ad67a8f453e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:02.201368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c193d85-0d2e-4f48-a0d5-ad67a8f453e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:02.203008 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c193d85-0d2e-4f48-a0d5-ad67a8f453e4 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:02.214154 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1422/2846] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:02.218338 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1715827-0145-4fcb-b741-3f7b9d2beeb8 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:02.229418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1715827-0145-4fcb-b741-3f7b9d2beeb8 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:02.234271 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbbc6e-e710-44f2-b4e1-19765ff32431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:02.234912 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbc6e-e710-44f2-b4e1-19765ff32431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:02.235188 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbc6e-e710-44f2-b4e1-19765ff32431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:02.235458 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbc6e-e710-44f2-b4e1-19765ff32431 admin admin] PATH_INFO: `/v3/projects/7bc11d38d38b402b9e26cc286e860e96/users/10d14bb1308e4583b290e1e087639a83/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:02.250825 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbbc6e-e710-44f2-b4e1-19765ff32431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc11d38d38b402b9e26cc286e860e96, user_id=10d14bb1308e4583b290e1e087639a83, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:02.253848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbbc6e-e710-44f2-b4e1-19765ff32431 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:02.344848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1425/2847] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:46:02 2022] PUT /identity/v3/projects/7bc11d38d38b402b9e26cc286e860e96/users/10d14bb1308e4583b290e1e087639a83/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:02.348768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193d85-0d2e-4f48-a0d5-ad67a8f453e4 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:02.358713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193d85-0d2e-4f48-a0d5-ad67a8f453e4 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:02.399022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:02.414518 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c90b2-bb1f-4e50-b299-98fa6895be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:02.415113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c90b2-bb1f-4e50-b299-98fa6895be7b admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:02.415395 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c90b2-bb1f-4e50-b299-98fa6895be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:02.415677 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c90b2-bb1f-4e50-b299-98fa6895be7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:02.416298 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c90b2-bb1f-4e50-b299-98fa6895be7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:02.417935 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c90b2-bb1f-4e50-b299-98fa6895be7b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:02.427235 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1423/2848] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:02.431457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbbc6e-e710-44f2-b4e1-19765ff32431 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:02.441679 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbbc6e-e710-44f2-b4e1-19765ff32431 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:02.447066 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0de9bd-3803-469e-af66-1f68222475f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:02.447713 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de9bd-3803-469e-af66-1f68222475f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:02.447993 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de9bd-3803-469e-af66-1f68222475f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:02.448269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0de9bd-3803-469e-af66-1f68222475f2 admin admin] PATH_INFO: `/v3/projects/7bc11d38d38b402b9e26cc286e860e96/users/10d14bb1308e4583b290e1e087639a83/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:02.450192 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0de9bd-3803-469e-af66-1f68222475f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc11d38d38b402b9e26cc286e860e96, user_id=10d14bb1308e4583b290e1e087639a83, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:02.452804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0de9bd-3803-469e-af66-1f68222475f2 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:02.463689 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1426/2849] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:46:02 2022] PUT /identity/v3/projects/7bc11d38d38b402b9e26cc286e860e96/users/10d14bb1308e4583b290e1e087639a83/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:02.529429 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722867-4e35-4d6a-9b12-e943c693e089 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:02.529756 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722867-4e35-4d6a-9b12-e943c693e089 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:02.530039 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722867-4e35-4d6a-9b12-e943c693e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:02.558360 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-fb722867-4e35-4d6a-9b12-e943c693e089 None None] MFA Rules not processed for user `10d14bb1308e4583b290e1e087639a83`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:02.559572 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-fb722867-4e35-4d6a-9b12-e943c693e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:02.627149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1424/2850] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:02.638468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0de9bd-3803-469e-af66-1f68222475f2 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:02.640151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1c0de9bd-3803-469e-af66-1f68222475f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:02.698574 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0de9bd-3803-469e-af66-1f68222475f2 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:02.702233 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e911f09-3124-4fa0-8751-bc6c239b2026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:02.702846 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e911f09-3124-4fa0-8751-bc6c239b2026 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:02.703127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e911f09-3124-4fa0-8751-bc6c239b2026 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:02.703402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e911f09-3124-4fa0-8751-bc6c239b2026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:02.712891 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e911f09-3124-4fa0-8751-bc6c239b2026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:02.714380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e911f09-3124-4fa0-8751-bc6c239b2026 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:02.723954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1427/2851] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:46:03.943073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb722867-4e35-4d6a-9b12-e943c693e089 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:04.004550 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb722867-4e35-4d6a-9b12-e943c693e089 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:04.009625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:04.010325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:04.010610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:04.010886 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] PATH_INFO: `/v3/users/4a59c6814d714e8a889052b99c6ea375` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:04.012006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a59c6814d714e8a889052b99c6ea375)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:04.013958 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:04.190861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a59c6814d714e8a889052b99c6ea375'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:04.268727 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a59c6814d714e8a889052b99c6ea375'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:04.269351 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a59c6814d714e8a889052b99c6ea375'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:04.278320 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:04.282657 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a59c6814d714e8a889052b99c6ea375'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:04.283310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a59c6814d714e8a889052b99c6ea375'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:04.295350 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1425/2852] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:46:03 2022] DELETE /identity/v3/users/4a59c6814d714e8a889052b99c6ea375 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:04.300049 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5c630-9280-4b5f-aeb0-58fb73a2b5b5 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:04.300537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5c630-9280-4b5f-aeb0-58fb73a2b5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:04.303208 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5c630-9280-4b5f-aeb0-58fb73a2b5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:04.320244 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c4c5c630-9280-4b5f-aeb0-58fb73a2b5b5 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:04.321442 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c4c5c630-9280-4b5f-aeb0-58fb73a2b5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:04.340656 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:04.377768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1428/2853] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:04.388461 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:04.389889 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:04.447073 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1426b-ec53-4482-b0e9-98ce74935c56 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:04.450680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67994790-5106-4c95-bb92-a6f2f749879f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:04.451299 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994790-5106-4c95-bb92-a6f2f749879f service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:04.451570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994790-5106-4c95-bb92-a6f2f749879f service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:04.451842 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994790-5106-4c95-bb92-a6f2f749879f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:04.460847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67994790-5106-4c95-bb92-a6f2f749879f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:04.462402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67994790-5106-4c95-bb92-a6f2f749879f service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:04.471758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1426/2854] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:46:04.890096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5c630-9280-4b5f-aeb0-58fb73a2b5b5 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:04.892392 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c4c5c630-9280-4b5f-aeb0-58fb73a2b5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:04.903374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5c630-9280-4b5f-aeb0-58fb73a2b5b5 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:04.908232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:04.908878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:04.909159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:04.909571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] PATH_INFO: `/v3/projects/fce3448f44a44cecba1338c1d42f6a1e` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:04.910638 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce3448f44a44cecba1338c1d42f6a1e)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:04.912552 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:05.015374 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce3448f44a44cecba1338c1d42f6a1e', 'request_id': 'req-ede7eb10-f699-4eba-98b1-0d17c412ce4c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:05.021629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce3448f44a44cecba1338c1d42f6a1e', 'request_id': 'req-ede7eb10-f699-4eba-98b1-0d17c412ce4c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:05.140013 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce3448f44a44cecba1338c1d42f6a1e', 'request_id': 'req-ede7eb10-f699-4eba-98b1-0d17c412ce4c'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:05.154910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] The token cache is being invalidate because project fce3448f44a44cecba1338c1d42f6a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:46:05.155206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:05.156033 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:05.157440 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1429/2855] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:46:04 2022] DELETE /identity/v3/projects/fce3448f44a44cecba1338c1d42f6a1e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:05.161728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67994790-5106-4c95-bb92-a6f2f749879f service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:05.172532 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67994790-5106-4c95-bb92-a6f2f749879f service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:05.230868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:05.231496 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:05.231778 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:05.232052 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] PATH_INFO: `/v3/users/10d14bb1308e4583b290e1e087639a83` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:05.233185 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d14bb1308e4583b290e1e087639a83)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:05.235133 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:05.557295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d14bb1308e4583b290e1e087639a83'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:05.663118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d14bb1308e4583b290e1e087639a83'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:05.663763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d14bb1308e4583b290e1e087639a83'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:05.676425 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d14bb1308e4583b290e1e087639a83'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:05.677071 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-12ed0127-0120-4c3a-9957-5345674097cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d14bb1308e4583b290e1e087639a83'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:05.689579 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1427/2856] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:46:05 2022] DELETE /identity/v3/users/10d14bb1308e4583b290e1e087639a83 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:06.124341 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:06.126495 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:06.139498 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7eb10-f699-4eba-98b1-0d17c412ce4c admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:06.199159 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:06.199769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:06.200053 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:06.200375 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] PATH_INFO: `/v3/projects/7bc11d38d38b402b9e26cc286e860e96` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:06.201466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc11d38d38b402b9e26cc286e860e96)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:06.203502 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:06.340039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc11d38d38b402b9e26cc286e860e96', 'request_id': 'req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:06.341953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:06.346549 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc11d38d38b402b9e26cc286e860e96', 'request_id': 'req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:06.446531 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc11d38d38b402b9e26cc286e860e96', 'request_id': 'req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:06.457428 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] The token cache is being invalidate because project 7bc11d38d38b402b9e26cc286e860e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:46:06.457745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:06.458373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-bdc9a3d1-ca98-4e4a-8460-193bd4929edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:06.459862 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1430/2857] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:46:06 2022] DELETE /identity/v3/projects/7bc11d38d38b402b9e26cc286e860e96 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:06.465034 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69209af-9ebd-486c-a4b2-eff2a2eb11e9 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:06.465557 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69209af-9ebd-486c-a4b2-eff2a2eb11e9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:06.465659 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69209af-9ebd-486c-a4b2-eff2a2eb11e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:06.471535 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:06.515638 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b69209af-9ebd-486c-a4b2-eff2a2eb11e9 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:06.516838 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b69209af-9ebd-486c-a4b2-eff2a2eb11e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:06.578274 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1428/2858] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:06.586201 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae54b44-d466-4445-a1e4-c16c83fece85 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:06.586489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae54b44-d466-4445-a1e4-c16c83fece85 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:06.586766 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae54b44-d466-4445-a1e4-c16c83fece85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:06.606811 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-6ae54b44-d466-4445-a1e4-c16c83fece85 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:06.608003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-6ae54b44-d466-4445-a1e4-c16c83fece85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:06.616109 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1431/2859] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:46:06.621173 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69209af-9ebd-486c-a4b2-eff2a2eb11e9 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:06.630699 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69209af-9ebd-486c-a4b2-eff2a2eb11e9 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:06.635939 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3361-3b2e-4399-b40e-6a0c17debfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:06.636541 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3361-3b2e-4399-b40e-6a0c17debfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:06.636828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3361-3b2e-4399-b40e-6a0c17debfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:06.637109 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3361-3b2e-4399-b40e-6a0c17debfc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:06.637798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e3361-3b2e-4399-b40e-6a0c17debfc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:46:06.638145 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e3361-3b2e-4399-b40e-6a0c17debfc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:06.639740 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e3361-3b2e-4399-b40e-6a0c17debfc9 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:06.651471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1429/2860] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:46:06.655960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae54b44-d466-4445-a1e4-c16c83fece85 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:06.665553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae54b44-d466-4445-a1e4-c16c83fece85 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:06.670777 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532a68c-61e3-4153-9e0e-c34fcaee4f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:06.671376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a68c-61e3-4153-9e0e-c34fcaee4f68 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:06.671653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a68c-61e3-4153-9e0e-c34fcaee4f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:06.671921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a68c-61e3-4153-9e0e-c34fcaee4f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:06.672544 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532a68c-61e3-4153-9e0e-c34fcaee4f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:06.674546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532a68c-61e3-4153-9e0e-c34fcaee4f68 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:06.773108 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1432/2861] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:46:06 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:46:06.783671 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3361-3b2e-4399-b40e-6a0c17debfc9 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:06.793764 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3361-3b2e-4399-b40e-6a0c17debfc9 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:06.853825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca64a2e-e5bf-44da-80aa-c30826362e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:06.854471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca64a2e-e5bf-44da-80aa-c30826362e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:06.854706 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca64a2e-e5bf-44da-80aa-c30826362e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:06.855002 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca64a2e-e5bf-44da-80aa-c30826362e03 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:06.855653 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca64a2e-e5bf-44da-80aa-c30826362e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:06.857560 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca64a2e-e5bf-44da-80aa-c30826362e03 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:06.965909 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1430/2862] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:46:06 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:46:06.969944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532a68c-61e3-4153-9e0e-c34fcaee4f68 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:06.980619 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532a68c-61e3-4153-9e0e-c34fcaee4f68 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:06.985136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18d83-438e-40d3-859e-59823fadae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:06.985772 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18d83-438e-40d3-859e-59823fadae26 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:06.986057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18d83-438e-40d3-859e-59823fadae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:06.986331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18d83-438e-40d3-859e-59823fadae26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:06.986975 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e18d83-438e-40d3-859e-59823fadae26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:06.988554 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e18d83-438e-40d3-859e-59823fadae26 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:06.999203 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1433/2863] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:07.003398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca64a2e-e5bf-44da-80aa-c30826362e03 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:07.013347 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca64a2e-e5bf-44da-80aa-c30826362e03 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:07.018064 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118af2b5-98c6-408c-b753-88cfa283840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:07.018654 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118af2b5-98c6-408c-b753-88cfa283840b admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:07.018942 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118af2b5-98c6-408c-b753-88cfa283840b admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:07.019220 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118af2b5-98c6-408c-b753-88cfa283840b admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:07.019863 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118af2b5-98c6-408c-b753-88cfa283840b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:07.021479 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118af2b5-98c6-408c-b753-88cfa283840b admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:07.032006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1431/2864] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:07.036028 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18d83-438e-40d3-859e-59823fadae26 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:07.046771 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18d83-438e-40d3-859e-59823fadae26 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:07.051226 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d82987-cba6-4578-8083-3a1a38da1785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:07.051864 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d82987-cba6-4578-8083-3a1a38da1785 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:07.052142 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d82987-cba6-4578-8083-3a1a38da1785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:07.052417 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d82987-cba6-4578-8083-3a1a38da1785 admin admin] PATH_INFO: `/v3/projects/894c95e981dd4e62b80488199c3ac4f4/users/3aad441f9c2e4d75827d4b5876a07e1a/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:07.067404 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d82987-cba6-4578-8083-3a1a38da1785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=894c95e981dd4e62b80488199c3ac4f4, user_id=3aad441f9c2e4d75827d4b5876a07e1a, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:07.070101 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d82987-cba6-4578-8083-3a1a38da1785 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:07.172022 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1434/2865] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:46:07 2022] PUT /identity/v3/projects/894c95e981dd4e62b80488199c3ac4f4/users/3aad441f9c2e4d75827d4b5876a07e1a/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:07.183223 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2753e-3d18-4e24-8596-215721894842 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:07.183547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2753e-3d18-4e24-8596-215721894842 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:07.183825 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2753e-3d18-4e24-8596-215721894842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:07.214139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ebb2753e-3d18-4e24-8596-215721894842 None None] MFA Rules not processed for user `3aad441f9c2e4d75827d4b5876a07e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:07.215364 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ebb2753e-3d18-4e24-8596-215721894842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:07.249047 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:07.279792 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1432/2866] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:07.285283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d82987-cba6-4578-8083-3a1a38da1785 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:07.349784 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d82987-cba6-4578-8083-3a1a38da1785 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:07.355123 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72f291-8ad0-4c81-bf18-c1014c6eeaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:07.355836 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72f291-8ad0-4c81-bf18-c1014c6eeaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:07.356118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72f291-8ad0-4c81-bf18-c1014c6eeaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:07.361692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72f291-8ad0-4c81-bf18-c1014c6eeaa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:07.361692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72f291-8ad0-4c81-bf18-c1014c6eeaa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:07.361692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72f291-8ad0-4c81-bf18-c1014c6eeaa0 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:07.501357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1435/2867] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:46:07 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:46:07.505506 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2753e-3d18-4e24-8596-215721894842 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:07.516365 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2753e-3d18-4e24-8596-215721894842 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:07.573262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb009dc-b02b-4787-a411-d978369e1a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:07.573810 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb009dc-b02b-4787-a411-d978369e1a78 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:07.574091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb009dc-b02b-4787-a411-d978369e1a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:07.574363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb009dc-b02b-4787-a411-d978369e1a78 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:07.574996 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb009dc-b02b-4787-a411-d978369e1a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:07.576907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb009dc-b02b-4787-a411-d978369e1a78 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:07.677868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1433/2868] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:46:07 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:46:07.682026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72f291-8ad0-4c81-bf18-c1014c6eeaa0 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:07.692185 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72f291-8ad0-4c81-bf18-c1014c6eeaa0 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:07.697228 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d89f02-0d51-493c-abab-484de28eb4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:07.697848 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89f02-0d51-493c-abab-484de28eb4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:07.698145 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89f02-0d51-493c-abab-484de28eb4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:07.698514 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89f02-0d51-493c-abab-484de28eb4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:07.699098 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d89f02-0d51-493c-abab-484de28eb4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:07.700675 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d89f02-0d51-493c-abab-484de28eb4b1 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:07.711887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1436/2869] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:07.715914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb009dc-b02b-4787-a411-d978369e1a78 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:07.725983 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb009dc-b02b-4787-a411-d978369e1a78 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:07.730489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c29144-a883-498e-ae58-8954342446ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:07.731095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29144-a883-498e-ae58-8954342446ec admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:07.731375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29144-a883-498e-ae58-8954342446ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:07.731903 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29144-a883-498e-ae58-8954342446ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:07.732289 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c29144-a883-498e-ae58-8954342446ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:07.733921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c29144-a883-498e-ae58-8954342446ec admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:07.743951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1434/2870] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:07.748093 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d89f02-0d51-493c-abab-484de28eb4b1 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:07.758556 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d89f02-0d51-493c-abab-484de28eb4b1 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:07.763316 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f23e9b-920c-4458-9e0b-18fbaac2568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:07.763987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f23e9b-920c-4458-9e0b-18fbaac2568a admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:07.764266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f23e9b-920c-4458-9e0b-18fbaac2568a admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:07.764542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f23e9b-920c-4458-9e0b-18fbaac2568a admin admin] PATH_INFO: `/v3/projects/dfdaaa96ddb440e7b5104f20c17f3526/users/feb289c6a3554ba1be5da1a1974125d8/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:07.780039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f23e9b-920c-4458-9e0b-18fbaac2568a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfdaaa96ddb440e7b5104f20c17f3526, user_id=feb289c6a3554ba1be5da1a1974125d8, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:07.782768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f23e9b-920c-4458-9e0b-18fbaac2568a admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:07.857250 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1437/2871] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:46:07 2022] PUT /identity/v3/projects/dfdaaa96ddb440e7b5104f20c17f3526/users/feb289c6a3554ba1be5da1a1974125d8/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:07.868879 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb4ed9-049e-4001-b725-b5a9741a7818 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:07.869164 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb4ed9-049e-4001-b725-b5a9741a7818 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:07.869438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb4ed9-049e-4001-b725-b5a9741a7818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:07.897751 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-44cb4ed9-049e-4001-b725-b5a9741a7818 None None] MFA Rules not processed for user `feb289c6a3554ba1be5da1a1974125d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:07.899553 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-44cb4ed9-049e-4001-b725-b5a9741a7818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:07.962009 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1435/2872] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:07.966668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f23e9b-920c-4458-9e0b-18fbaac2568a admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:07.996635 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:08.028136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f23e9b-920c-4458-9e0b-18fbaac2568a admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:08.033441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f57493-4431-4d33-a869-bf6593b235d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:08.034075 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f57493-4431-4d33-a869-bf6593b235d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:08.034357 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f57493-4431-4d33-a869-bf6593b235d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:08.034632 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f57493-4431-4d33-a869-bf6593b235d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:08.035280 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f57493-4431-4d33-a869-bf6593b235d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:08.037171 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f57493-4431-4d33-a869-bf6593b235d5 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:08.129111 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1438/2873] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:46:07 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:46:08.133840 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb4ed9-049e-4001-b725-b5a9741a7818 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:08.144547 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb4ed9-049e-4001-b725-b5a9741a7818 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:08.185278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:08.200084 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08828a27-0087-48d5-8d95-49e9abdea4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:08.200696 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828a27-0087-48d5-8d95-49e9abdea4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:08.200981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828a27-0087-48d5-8d95-49e9abdea4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:08.201257 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828a27-0087-48d5-8d95-49e9abdea4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:08.201943 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08828a27-0087-48d5-8d95-49e9abdea4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:08.203868 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08828a27-0087-48d5-8d95-49e9abdea4f5 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:08.297001 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1436/2874] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:46:08 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:46:08.301035 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f57493-4431-4d33-a869-bf6593b235d5 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:08.312094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f57493-4431-4d33-a869-bf6593b235d5 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:08.316814 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0bf6a-cdd7-4238-84d0-51f7d6e502c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:08.317411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0bf6a-cdd7-4238-84d0-51f7d6e502c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:08.317725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0bf6a-cdd7-4238-84d0-51f7d6e502c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:08.318005 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0bf6a-cdd7-4238-84d0-51f7d6e502c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:08.318649 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0bf6a-cdd7-4238-84d0-51f7d6e502c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:08.320242 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0bf6a-cdd7-4238-84d0-51f7d6e502c3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:08.330385 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1439/2875] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:08.334408 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08828a27-0087-48d5-8d95-49e9abdea4f5 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:08.344445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08828a27-0087-48d5-8d95-49e9abdea4f5 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:08.349135 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b77f-34e1-4f9f-a2aa-76b1c56cb95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:08.349818 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b77f-34e1-4f9f-a2aa-76b1c56cb95d admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:08.350107 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b77f-34e1-4f9f-a2aa-76b1c56cb95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:08.350384 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b77f-34e1-4f9f-a2aa-76b1c56cb95d admin admin] PATH_INFO: `/v3/projects/50cf7eb047764cf2bde0d4f017698856/users/bd155cb8bfca499daecbaa43c2a2b128/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:08.365447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510b77f-34e1-4f9f-a2aa-76b1c56cb95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cf7eb047764cf2bde0d4f017698856, user_id=bd155cb8bfca499daecbaa43c2a2b128, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:08.368966 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510b77f-34e1-4f9f-a2aa-76b1c56cb95d admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:08.447665 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1437/2876] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:46:08 2022] PUT /identity/v3/projects/50cf7eb047764cf2bde0d4f017698856/users/bd155cb8bfca499daecbaa43c2a2b128/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:08.451727 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0bf6a-cdd7-4238-84d0-51f7d6e502c3 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:08.462178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0bf6a-cdd7-4238-84d0-51f7d6e502c3 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:08.518669 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564461a-b5be-4b01-9b9e-2b973a1243d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:08.519327 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564461a-b5be-4b01-9b9e-2b973a1243d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:08.519608 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564461a-b5be-4b01-9b9e-2b973a1243d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:08.519882 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564461a-b5be-4b01-9b9e-2b973a1243d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:08.520525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564461a-b5be-4b01-9b9e-2b973a1243d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:08.522151 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564461a-b5be-4b01-9b9e-2b973a1243d6 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:08.532445 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1440/2877] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:08.536729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b77f-34e1-4f9f-a2aa-76b1c56cb95d admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:08.547854 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b77f-34e1-4f9f-a2aa-76b1c56cb95d admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:08.552716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28d0d3-02d4-4dba-ba15-e1ff3e32bbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:08.553409 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28d0d3-02d4-4dba-ba15-e1ff3e32bbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:08.553731 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28d0d3-02d4-4dba-ba15-e1ff3e32bbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:08.554022 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28d0d3-02d4-4dba-ba15-e1ff3e32bbd8 admin admin] PATH_INFO: `/v3/projects/50cf7eb047764cf2bde0d4f017698856/users/bd155cb8bfca499daecbaa43c2a2b128/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:08.556675 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28d0d3-02d4-4dba-ba15-e1ff3e32bbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cf7eb047764cf2bde0d4f017698856, user_id=bd155cb8bfca499daecbaa43c2a2b128, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:08.559418 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28d0d3-02d4-4dba-ba15-e1ff3e32bbd8 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:08.570225 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1438/2878] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:46:08 2022] PUT /identity/v3/projects/50cf7eb047764cf2bde0d4f017698856/users/bd155cb8bfca499daecbaa43c2a2b128/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:08.580254 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbc5e0-5b7e-45e4-aac5-7da693a05ad8 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:08.580612 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbc5e0-5b7e-45e4-aac5-7da693a05ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:08.580953 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbc5e0-5b7e-45e4-aac5-7da693a05ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:08.610174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-d1dbc5e0-5b7e-45e4-aac5-7da693a05ad8 None None] MFA Rules not processed for user `bd155cb8bfca499daecbaa43c2a2b128`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:08.611021 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d1dbc5e0-5b7e-45e4-aac5-7da693a05ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:08.688131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1441/2879] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:08.715193 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28d0d3-02d4-4dba-ba15-e1ff3e32bbd8 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:08.717081 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ed28d0d3-02d4-4dba-ba15-e1ff3e32bbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:08.781448 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28d0d3-02d4-4dba-ba15-e1ff3e32bbd8 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:08.785146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9880-99a1-4d0a-bb12-56e0be558cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:08.785784 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9880-99a1-4d0a-bb12-56e0be558cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:08.786092 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9880-99a1-4d0a-bb12-56e0be558cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:08.786371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9880-99a1-4d0a-bb12-56e0be558cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:08.842898 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f9880-99a1-4d0a-bb12-56e0be558cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:08.844337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f9880-99a1-4d0a-bb12-56e0be558cc3 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:08.853623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1439/2880] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:46:10.862001 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbc5e0-5b7e-45e4-aac5-7da693a05ad8 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:10.863393 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-d1dbc5e0-5b7e-45e4-aac5-7da693a05ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:10.875548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbc5e0-5b7e-45e4-aac5-7da693a05ad8 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:10.879046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3984b7-5d09-4ea8-8c3d-f0826a380fa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:10.879666 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3984b7-5d09-4ea8-8c3d-f0826a380fa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:10.879938 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3984b7-5d09-4ea8-8c3d-f0826a380fa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:10.880206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3984b7-5d09-4ea8-8c3d-f0826a380fa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:10.900897 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:10.938639 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3984b7-5d09-4ea8-8c3d-f0826a380fa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:10.940095 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3984b7-5d09-4ea8-8c3d-f0826a380fa8 service cinder] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:10.949653 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1442/2881] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:46:12.419860 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9880-99a1-4d0a-bb12-56e0be558cc3 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:12.428613 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9880-99a1-4d0a-bb12-56e0be558cc3 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:12.432271 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85074f-859b-4759-860d-9d746f3141d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:12.432876 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85074f-859b-4759-860d-9d746f3141d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:12.433146 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85074f-859b-4759-860d-9d746f3141d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:12.433423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85074f-859b-4759-860d-9d746f3141d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:12.442209 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85074f-859b-4759-860d-9d746f3141d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:12.443623 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85074f-859b-4759-860d-9d746f3141d7 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:12.452887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1440/2882] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:46:17.058691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3984b7-5d09-4ea8-8c3d-f0826a380fa8 service cinder] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:17.120921 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3984b7-5d09-4ea8-8c3d-f0826a380fa8 service cinder] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:17.125386 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:17.126048 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:17.126331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:17.126605 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] PATH_INFO: `/v3/users/3aad441f9c2e4d75827d4b5876a07e1a` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:17.127748 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aad441f9c2e4d75827d4b5876a07e1a)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:17.129702 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:17.443227 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aad441f9c2e4d75827d4b5876a07e1a'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:17.444240 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aad441f9c2e4d75827d4b5876a07e1a'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:17.444462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aad441f9c2e4d75827d4b5876a07e1a'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:17.525677 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aad441f9c2e4d75827d4b5876a07e1a'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:17.539454 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aad441f9c2e4d75827d4b5876a07e1a'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:17.552954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1443/2883] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:46:17 2022] DELETE /identity/v3/users/3aad441f9c2e4d75827d4b5876a07e1a => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:17.558122 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbceab-4349-4e2b-bcd6-fd8121e8a3c6 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:17.558625 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbceab-4349-4e2b-bcd6-fd8121e8a3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:17.558734 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbceab-4349-4e2b-bcd6-fd8121e8a3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:17.577433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-13fbceab-4349-4e2b-bcd6-fd8121e8a3c6 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:17.578662 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-13fbceab-4349-4e2b-bcd6-fd8121e8a3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:17.610754 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:17.637295 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1441/2884] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:17.647096 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:17.648499 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:17.691877 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:17.706061 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94d30-7a44-4efb-b312-aacf4b422bdd admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:17.710249 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188c81-1a56-4f9a-99f7-1a9d4c926839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:17.711127 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188c81-1a56-4f9a-99f7-1a9d4c926839 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:17.711450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188c81-1a56-4f9a-99f7-1a9d4c926839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:17.711767 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188c81-1a56-4f9a-99f7-1a9d4c926839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:17.722003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f188c81-1a56-4f9a-99f7-1a9d4c926839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:17.723429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f188c81-1a56-4f9a-99f7-1a9d4c926839 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:17.733573 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1444/2885] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:46:18.153204 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbceab-4349-4e2b-bcd6-fd8121e8a3c6 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:18.155277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-13fbceab-4349-4e2b-bcd6-fd8121e8a3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:18.166993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbceab-4349-4e2b-bcd6-fd8121e8a3c6 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:18.171973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:18.172679 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:18.172975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:18.173285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] PATH_INFO: `/v3/projects/894c95e981dd4e62b80488199c3ac4f4` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:18.174454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=894c95e981dd4e62b80488199c3ac4f4)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:18.176403 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:18.282959 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894c95e981dd4e62b80488199c3ac4f4', 'request_id': 'req-073d8852-9e18-46e5-b268-9e30290e82b0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:18.288981 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894c95e981dd4e62b80488199c3ac4f4', 'request_id': 'req-073d8852-9e18-46e5-b268-9e30290e82b0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:18.368144 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894c95e981dd4e62b80488199c3ac4f4', 'request_id': 'req-073d8852-9e18-46e5-b268-9e30290e82b0'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:18.379982 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] The token cache is being invalidate because project 894c95e981dd4e62b80488199c3ac4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:46:18.380303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:18.380929 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:18.382445 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1442/2886] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:46:18 2022] DELETE /identity/v3/projects/894c95e981dd4e62b80488199c3ac4f4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:18.387030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188c81-1a56-4f9a-99f7-1a9d4c926839 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:18.396422 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188c81-1a56-4f9a-99f7-1a9d4c926839 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:18.450832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:18.451468 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:18.451753 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:18.452031 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] PATH_INFO: `/v3/users/feb289c6a3554ba1be5da1a1974125d8` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:18.453305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb289c6a3554ba1be5da1a1974125d8)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:18.455265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:18.667230 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb289c6a3554ba1be5da1a1974125d8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:18.667870 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb289c6a3554ba1be5da1a1974125d8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:18.668467 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb289c6a3554ba1be5da1a1974125d8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:18.746137 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb289c6a3554ba1be5da1a1974125d8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:18.758960 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb289c6a3554ba1be5da1a1974125d8'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:18.770924 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1445/2887] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:46:18 2022] DELETE /identity/v3/users/feb289c6a3554ba1be5da1a1974125d8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:19.201262 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:19.202785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:19.216610 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8852-9e18-46e5-b268-9e30290e82b0 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:19.276768 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:19.277414 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:19.277729 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:19.278012 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] PATH_INFO: `/v3/projects/dfdaaa96ddb440e7b5104f20c17f3526` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:19.279207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfdaaa96ddb440e7b5104f20c17f3526)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:19.281236 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:19.404321 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfdaaa96ddb440e7b5104f20c17f3526', 'request_id': 'req-b1048ba2-ddde-484f-b895-cfe6b6a01587'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:19.410434 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfdaaa96ddb440e7b5104f20c17f3526', 'request_id': 'req-b1048ba2-ddde-484f-b895-cfe6b6a01587'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:19.491681 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfdaaa96ddb440e7b5104f20c17f3526', 'request_id': 'req-b1048ba2-ddde-484f-b895-cfe6b6a01587'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:19.494304 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:19.503172 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] The token cache is being invalidate because project dfdaaa96ddb440e7b5104f20c17f3526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:46:19.503458 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:19.504077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:19.505562 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1443/2888] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:46:19 2022] DELETE /identity/v3/projects/dfdaaa96ddb440e7b5104f20c17f3526 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:19.509602 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:19.511725 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:19.525024 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc54ba0-316f-4f8b-908c-1a53e727f34d admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:19.581460 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:19.582116 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:19.582381 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:19.582657 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] PATH_INFO: `/v3/users/bd155cb8bfca499daecbaa43c2a2b128` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:19.583769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd155cb8bfca499daecbaa43c2a2b128)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:19.585691 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:19.587974 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:19.747301 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd155cb8bfca499daecbaa43c2a2b128'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:19.747942 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd155cb8bfca499daecbaa43c2a2b128'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:19.748553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd155cb8bfca499daecbaa43c2a2b128'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:19.834252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd155cb8bfca499daecbaa43c2a2b128'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:19.847833 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-14707a28-f623-42b6-a965-10392c4439c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd155cb8bfca499daecbaa43c2a2b128'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:19.859487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1446/2889] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:46:19 2022] DELETE /identity/v3/users/bd155cb8bfca499daecbaa43c2a2b128 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:20.265510 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:20.267260 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:20.281648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1048ba2-ddde-484f-b895-cfe6b6a01587 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:20.339369 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:20.340014 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:20.340305 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:20.340585 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] PATH_INFO: `/v3/projects/50cf7eb047764cf2bde0d4f017698856` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:20.341753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cf7eb047764cf2bde0d4f017698856)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:20.345131 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:20.460064 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cf7eb047764cf2bde0d4f017698856', 'request_id': 'req-fb48eddb-4d87-4200-9f05-9d9ed94f4300'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:20.467576 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cf7eb047764cf2bde0d4f017698856', 'request_id': 'req-fb48eddb-4d87-4200-9f05-9d9ed94f4300'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:20.534294 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cf7eb047764cf2bde0d4f017698856', 'request_id': 'req-fb48eddb-4d87-4200-9f05-9d9ed94f4300'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:20.552990 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] The token cache is being invalidate because project 50cf7eb047764cf2bde0d4f017698856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81728) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:46:20.553280 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:20.553976 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-fb48eddb-4d87-4200-9f05-9d9ed94f4300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:46:20.555471 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1444/2890] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:46:20 2022] DELETE /identity/v3/projects/50cf7eb047764cf2bde0d4f017698856 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:20.560970 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc41f6-d994-4fe7-a9c1-e83b56bd6157 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:20.561439 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc41f6-d994-4fe7-a9c1-e83b56bd6157 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:20.561535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc41f6-d994-4fe7-a9c1-e83b56bd6157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:20.580894 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c8bc41f6-d994-4fe7-a9c1-e83b56bd6157 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:20.582183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c8bc41f6-d994-4fe7-a9c1-e83b56bd6157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:20.643704 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1447/2891] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:20.654243 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57796fb1-20e7-4b9e-b230-654feb4ca277 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:20.654525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57796fb1-20e7-4b9e-b230-654feb4ca277 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:20.654802 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57796fb1-20e7-4b9e-b230-654feb4ca277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:20.677110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-57796fb1-20e7-4b9e-b230-654feb4ca277 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:20.678358 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-57796fb1-20e7-4b9e-b230-654feb4ca277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:20.687108 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1445/2892] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:20.691660 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc41f6-d994-4fe7-a9c1-e83b56bd6157 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:20.701642 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc41f6-d994-4fe7-a9c1-e83b56bd6157 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:20.706281 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171f2a9-bd24-4761-8042-bc53c089ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:20.706881 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f2a9-bd24-4761-8042-bc53c089ef38 admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:20.707154 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f2a9-bd24-4761-8042-bc53c089ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:20.707424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f2a9-bd24-4761-8042-bc53c089ef38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:20.708068 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f2a9-bd24-4761-8042-bc53c089ef38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81727) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:46:20.708371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f2a9-bd24-4761-8042-bc53c089ef38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:20.710191 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f2a9-bd24-4761-8042-bc53c089ef38 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:20.723239 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1448/2893] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:46:20.727744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57796fb1-20e7-4b9e-b230-654feb4ca277 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:20.737543 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57796fb1-20e7-4b9e-b230-654feb4ca277 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:20.742803 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c41e7f-605d-400a-9b0c-cb8ed0a035a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:20.743438 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c41e7f-605d-400a-9b0c-cb8ed0a035a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:20.743726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c41e7f-605d-400a-9b0c-cb8ed0a035a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:20.744005 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c41e7f-605d-400a-9b0c-cb8ed0a035a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:20.744644 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c41e7f-605d-400a-9b0c-cb8ed0a035a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:20.746627 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c41e7f-605d-400a-9b0c-cb8ed0a035a2 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:20.830375 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1446/2894] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:46:20 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:46:20.834793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171f2a9-bd24-4761-8042-bc53c089ef38 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:20.845599 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171f2a9-bd24-4761-8042-bc53c089ef38 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:20.904179 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a4214-3749-43bd-a73f-9dc8564294f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:20.904793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a4214-3749-43bd-a73f-9dc8564294f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:20.905122 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a4214-3749-43bd-a73f-9dc8564294f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:20.905449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a4214-3749-43bd-a73f-9dc8564294f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:20.906124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a4214-3749-43bd-a73f-9dc8564294f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:20.908042 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a4214-3749-43bd-a73f-9dc8564294f3 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:21.003303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:21.009954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1449/2895] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:46:20 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:46:21.014191 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c41e7f-605d-400a-9b0c-cb8ed0a035a2 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:21.025791 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c41e7f-605d-400a-9b0c-cb8ed0a035a2 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:21.030528 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6343a5-6bcd-40fb-9714-a6b360ed5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:21.031104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6343a5-6bcd-40fb-9714-a6b360ed5b05 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:21.031385 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6343a5-6bcd-40fb-9714-a6b360ed5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:21.031664 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6343a5-6bcd-40fb-9714-a6b360ed5b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:21.032342 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6343a5-6bcd-40fb-9714-a6b360ed5b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:21.033965 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6343a5-6bcd-40fb-9714-a6b360ed5b05 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:21.044391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1447/2896] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:21.048504 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a4214-3749-43bd-a73f-9dc8564294f3 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:21.058995 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a4214-3749-43bd-a73f-9dc8564294f3 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:21.064138 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8245ab-f2d2-49cc-a07f-36cc83dc465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:21.072744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8245ab-f2d2-49cc-a07f-36cc83dc465b admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:21.072744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8245ab-f2d2-49cc-a07f-36cc83dc465b admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:21.072744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8245ab-f2d2-49cc-a07f-36cc83dc465b admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:21.072744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8245ab-f2d2-49cc-a07f-36cc83dc465b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:21.072744 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8245ab-f2d2-49cc-a07f-36cc83dc465b admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:21.080535 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1450/2897] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:46:21.084956 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6343a5-6bcd-40fb-9714-a6b360ed5b05 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:21.095428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6343a5-6bcd-40fb-9714-a6b360ed5b05 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:21.100095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913afad-2570-41d4-83d2-c25dda9522c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:21.100747 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913afad-2570-41d4-83d2-c25dda9522c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:21.101049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913afad-2570-41d4-83d2-c25dda9522c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:21.101327 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913afad-2570-41d4-83d2-c25dda9522c1 admin admin] PATH_INFO: `/v3/projects/9f6c3996bf2a419e89771639fde12578/users/7e0954ad0ec342ad8c8c312214d24de8/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:21.116474 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913afad-2570-41d4-83d2-c25dda9522c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6c3996bf2a419e89771639fde12578, user_id=7e0954ad0ec342ad8c8c312214d24de8, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:21.119423 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913afad-2570-41d4-83d2-c25dda9522c1 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:21.194367 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1448/2898] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:46:21 2022] PUT /identity/v3/projects/9f6c3996bf2a419e89771639fde12578/users/7e0954ad0ec342ad8c8c312214d24de8/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:46:21.199570 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be29812-37a9-4880-88c9-71957f95599b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:21.199853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be29812-37a9-4880-88c9-71957f95599b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:21.200131 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be29812-37a9-4880-88c9-71957f95599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:21.218796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1be29812-37a9-4880-88c9-71957f95599b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:21.219999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1be29812-37a9-4880-88c9-71957f95599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:21.277623 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1451/2899] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:21.293826 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913afad-2570-41d4-83d2-c25dda9522c1 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:21.295632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1913afad-2570-41d4-83d2-c25dda9522c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:21.316494 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:21.355263 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913afad-2570-41d4-83d2-c25dda9522c1 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:21.359183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9126e85-a0d9-46c2-b55d-009bfc8944fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:21.359799 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126e85-a0d9-46c2-b55d-009bfc8944fd service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:21.360087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126e85-a0d9-46c2-b55d-009bfc8944fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:21.360368 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126e85-a0d9-46c2-b55d-009bfc8944fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:21.370682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9126e85-a0d9-46c2-b55d-009bfc8944fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:21.372121 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9126e85-a0d9-46c2-b55d-009bfc8944fd service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:21.381599 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1449/2900] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:46:22.655282 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a517b8-11f1-48c3-a1f4-3d657209bc27 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:22.655878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a517b8-11f1-48c3-a1f4-3d657209bc27 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:22.655878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a517b8-11f1-48c3-a1f4-3d657209bc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:22.687206 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-a2a517b8-11f1-48c3-a1f4-3d657209bc27 None None] MFA Rules not processed for user `7e0954ad0ec342ad8c8c312214d24de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:22.688424 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a2a517b8-11f1-48c3-a1f4-3d657209bc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:22.764662 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1452/2901] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:22.775521 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9126e85-a0d9-46c2-b55d-009bfc8944fd service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:22.777024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b9126e85-a0d9-46c2-b55d-009bfc8944fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:22.834779 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9126e85-a0d9-46c2-b55d-009bfc8944fd service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:22.838386 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c63476-b646-4929-9904-0566a9314344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:22.838993 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c63476-b646-4929-9904-0566a9314344 service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:22.839278 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c63476-b646-4929-9904-0566a9314344 service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:22.840042 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c63476-b646-4929-9904-0566a9314344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:22.848149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c63476-b646-4929-9904-0566a9314344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:22.849582 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c63476-b646-4929-9904-0566a9314344 service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:22.859426 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1450/2902] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:46:24.621019 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31080b72-f92f-43f3-b92a-ca01363ea020 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:24.627987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31080b72-f92f-43f3-b92a-ca01363ea020 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:24.627987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31080b72-f92f-43f3-b92a-ca01363ea020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:24.640528 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-31080b72-f92f-43f3-b92a-ca01363ea020 None None] MFA Rules not processed for user `7e0954ad0ec342ad8c8c312214d24de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:46:24.641764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-31080b72-f92f-43f3-b92a-ca01363ea020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:24.648625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1453/2903] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:46:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:46:24.893247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c63476-b646-4929-9904-0566a9314344 service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:24.894846 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-09c63476-b646-4929-9904-0566a9314344 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:24.907285 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c63476-b646-4929-9904-0566a9314344 service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:24.911443 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7d712-0828-48ac-b464-597f55c887e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:24.911443 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7d712-0828-48ac-b464-597f55c887e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:24.911738 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7d712-0828-48ac-b464-597f55c887e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:24.911921 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7d712-0828-48ac-b464-597f55c887e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:24.913682 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-77d7d712-0828-48ac-b464-597f55c887e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:24.923049 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7d712-0828-48ac-b464-597f55c887e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:24.924465 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7d712-0828-48ac-b464-597f55c887e2 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:24.932571 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1451/2904] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:46:27.371376 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31080b72-f92f-43f3-b92a-ca01363ea020 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:27.372832 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-31080b72-f92f-43f3-b92a-ca01363ea020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:27.448884 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31080b72-f92f-43f3-b92a-ca01363ea020 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:27.455910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ff3ab-2c5d-45e1-a9a9-92463030fd50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:27.456525 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ff3ab-2c5d-45e1-a9a9-92463030fd50 service placement] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:27.456808 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ff3ab-2c5d-45e1-a9a9-92463030fd50 service placement] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:27.457087 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ff3ab-2c5d-45e1-a9a9-92463030fd50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:27.458858 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-017ff3ab-2c5d-45e1-a9a9-92463030fd50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:27.471174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ff3ab-2c5d-45e1-a9a9-92463030fd50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:27.472775 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ff3ab-2c5d-45e1-a9a9-92463030fd50 service placement] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:27.478685 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=100 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:27.484761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1454/2905] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:46:34.928887 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=50 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:41.823446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7d712-0828-48ac-b464-597f55c887e2 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:46:41.825529 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-77d7d712-0828-48ac-b464-597f55c887e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:41.946834 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7d712-0828-48ac-b464-597f55c887e2 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:46:41.953085 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6259444-c0ec-4caf-8763-f9de273c182b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:46:41.954549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6259444-c0ec-4caf-8763-f9de273c182b service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:46:41.954549 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6259444-c0ec-4caf-8763-f9de273c182b service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:46:41.954893 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6259444-c0ec-4caf-8763-f9de273c182b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:46:41.957264 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d6259444-c0ec-4caf-8763-f9de273c182b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:46:41.974713 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6259444-c0ec-4caf-8763-f9de273c182b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:46:41.976359 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6259444-c0ec-4caf-8763-f9de273c182b service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:46:41.995422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1452/2906] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:46:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:46:51.983770 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=46 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:47:06.294954 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3fe77-4e9f-4040-8123-2cef5622f45f None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:06.295578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3fe77-4e9f-4040-8123-2cef5622f45f None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:06.295578 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3fe77-4e9f-4040-8123-2cef5622f45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:06.315401 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-1db3fe77-4e9f-4040-8123-2cef5622f45f None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:47:06.316620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-1db3fe77-4e9f-4040-8123-2cef5622f45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:47:06.324540 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1455/2907] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:47:06.352743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6259444-c0ec-4caf-8763-f9de273c182b service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:47:06.354716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d6259444-c0ec-4caf-8763-f9de273c182b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:47:06.369542 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6259444-c0ec-4caf-8763-f9de273c182b service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:47:06.376417 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99819bd-ef9c-42b1-b909-15953bad8e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:47:06.377044 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99819bd-ef9c-42b1-b909-15953bad8e16 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:06.377325 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99819bd-ef9c-42b1-b909-15953bad8e16 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:06.377599 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99819bd-ef9c-42b1-b909-15953bad8e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:06.386190 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99819bd-ef9c-42b1-b909-15953bad8e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:47:06.387823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99819bd-ef9c-42b1-b909-15953bad8e16 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:47:06.397509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1453/2908] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:47:10.619287 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe1cf0-aedf-464c-814e-b25197428fbe None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:10.619782 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe1cf0-aedf-464c-814e-b25197428fbe None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:10.619889 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe1cf0-aedf-464c-814e-b25197428fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:10.642917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-88fe1cf0-aedf-464c-814e-b25197428fbe None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:47:10.642917 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-88fe1cf0-aedf-464c-814e-b25197428fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:47:10.649452 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1456/2909] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:47:10.669460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99819bd-ef9c-42b1-b909-15953bad8e16 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:47:10.680719 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99819bd-ef9c-42b1-b909-15953bad8e16 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:47:10.686268 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628e97e-7e14-404b-9e2a-9b811caa4bc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:47:10.686885 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e97e-7e14-404b-9e2a-9b811caa4bc3 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:10.687158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e97e-7e14-404b-9e2a-9b811caa4bc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:10.687480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e97e-7e14-404b-9e2a-9b811caa4bc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:10.696704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628e97e-7e14-404b-9e2a-9b811caa4bc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:47:10.698363 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628e97e-7e14-404b-9e2a-9b811caa4bc3 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:47:10.708558 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1454/2910] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:47:15.273799 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec8a6-5faa-43ab-93e6-279b201c9a49 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:15.274380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec8a6-5faa-43ab-93e6-279b201c9a49 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:15.274380 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec8a6-5faa-43ab-93e6-279b201c9a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:15.293861 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-4ddec8a6-5faa-43ab-93e6-279b201c9a49 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:47:15.295057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-4ddec8a6-5faa-43ab-93e6-279b201c9a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:47:15.303399 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1457/2911] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:47:15.325472 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628e97e-7e14-404b-9e2a-9b811caa4bc3 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:47:15.336892 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628e97e-7e14-404b-9e2a-9b811caa4bc3 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:47:15.342279 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25e356-73bb-4673-b83d-a1aca8cd1616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:47:15.347758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25e356-73bb-4673-b83d-a1aca8cd1616 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:15.347758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25e356-73bb-4673-b83d-a1aca8cd1616 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:15.347758 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25e356-73bb-4673-b83d-a1aca8cd1616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:15.351407 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25e356-73bb-4673-b83d-a1aca8cd1616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:47:15.352967 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25e356-73bb-4673-b83d-a1aca8cd1616 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:47:15.362984 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1455/2912] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:47:19.123331 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed8690-cb0f-46d4-a7be-3e5fd7f8f5b1 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:19.124094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed8690-cb0f-46d4-a7be-3e5fd7f8f5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:19.124094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed8690-cb0f-46d4-a7be-3e5fd7f8f5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:19.143913 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-91ed8690-cb0f-46d4-a7be-3e5fd7f8f5b1 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:47:19.145133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-91ed8690-cb0f-46d4-a7be-3e5fd7f8f5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:47:19.153786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1458/2913] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:47:19.175481 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25e356-73bb-4673-b83d-a1aca8cd1616 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:47:19.187890 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25e356-73bb-4673-b83d-a1aca8cd1616 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:47:19.193406 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cad6b-82d4-45d6-bda4-3a207b69b1d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:47:19.194143 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cad6b-82d4-45d6-bda4-3a207b69b1d3 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:19.194422 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cad6b-82d4-45d6-bda4-3a207b69b1d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:19.194695 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cad6b-82d4-45d6-bda4-3a207b69b1d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:19.202650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cad6b-82d4-45d6-bda4-3a207b69b1d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:47:19.204194 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cad6b-82d4-45d6-bda4-3a207b69b1d3 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:47:19.213593 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1456/2914] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:47:23.388542 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ff1d4-e2da-4957-beb9-7d11368af27b None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:23.389092 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ff1d4-e2da-4957-beb9-7d11368af27b None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:23.389220 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ff1d4-e2da-4957-beb9-7d11368af27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:23.408237 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-9c8ff1d4-e2da-4957-beb9-7d11368af27b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:47:23.409436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-9c8ff1d4-e2da-4957-beb9-7d11368af27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:47:23.417370 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1459/2915] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:47:23.442703 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cad6b-82d4-45d6-bda4-3a207b69b1d3 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:47:23.454629 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cad6b-82d4-45d6-bda4-3a207b69b1d3 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:47:23.460239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411f27b-f541-4ac5-8ead-05b91a1eeb59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:47:23.460835 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411f27b-f541-4ac5-8ead-05b91a1eeb59 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:23.461118 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411f27b-f541-4ac5-8ead-05b91a1eeb59 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:23.461398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411f27b-f541-4ac5-8ead-05b91a1eeb59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:23.469641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411f27b-f541-4ac5-8ead-05b91a1eeb59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:47:23.471277 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411f27b-f541-4ac5-8ead-05b91a1eeb59 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:47:23.482174 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1457/2916] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:47:25.138792 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ff1d4-e2da-4957-beb9-7d11368af27b None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:47:25.162091 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ff1d4-e2da-4957-beb9-7d11368af27b None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:47:25.167046 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f307ab3-3c30-4fc7-8d9a-afbeba6fa055 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:47:25.167641 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f307ab3-3c30-4fc7-8d9a-afbeba6fa055 service placement] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:25.167947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f307ab3-3c30-4fc7-8d9a-afbeba6fa055 service placement] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:25.168214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f307ab3-3c30-4fc7-8d9a-afbeba6fa055 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:25.169989 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-5f307ab3-3c30-4fc7-8d9a-afbeba6fa055 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:47:25.196429 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f307ab3-3c30-4fc7-8d9a-afbeba6fa055 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:47:25.198034 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f307ab3-3c30-4fc7-8d9a-afbeba6fa055 service placement] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:47:25.208134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1460/2917] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:47:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:47:27.638845 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63241fbc-e123-4353-a7ff-f2d1497f671b None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:27.639398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63241fbc-e123-4353-a7ff-f2d1497f671b None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:27.639398 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63241fbc-e123-4353-a7ff-f2d1497f671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:27.660091 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-63241fbc-e123-4353-a7ff-f2d1497f671b None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:47:27.661297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-63241fbc-e123-4353-a7ff-f2d1497f671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:47:27.669828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1458/2918] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:47:27.694416 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f307ab3-3c30-4fc7-8d9a-afbeba6fa055 service placement] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:47:27.701125 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=31 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:47:27.707472 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f307ab3-3c30-4fc7-8d9a-afbeba6fa055 service placement] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:47:27.713859 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b08ec-5e26-4553-91d4-793aeaeabbc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:47:27.714462 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b08ec-5e26-4553-91d4-793aeaeabbc3 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:27.714738 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b08ec-5e26-4553-91d4-793aeaeabbc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:27.715008 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b08ec-5e26-4553-91d4-793aeaeabbc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:27.723489 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b08ec-5e26-4553-91d4-793aeaeabbc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:47:27.725065 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b08ec-5e26-4553-91d4-793aeaeabbc3 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:47:27.735248 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1461/2919] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:47:37.654961 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=33 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:47:37.752733 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:47:44.841302 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a409b-f726-46ba-92d5-a4ce81a007de None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:44.844250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a409b-f726-46ba-92d5-a4ce81a007de None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:44.844250 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a409b-f726-46ba-92d5-a4ce81a007de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:44.862310 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ad6a409b-f726-46ba-92d5-a4ce81a007de None None] MFA Rules not processed for user `7e0954ad0ec342ad8c8c312214d24de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:47:44.867139 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ad6a409b-f726-46ba-92d5-a4ce81a007de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:47:44.870798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1459/2920] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:47:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:47:45.107906 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b08ec-5e26-4553-91d4-793aeaeabbc3 service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:47:45.128003 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b08ec-5e26-4553-91d4-793aeaeabbc3 service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:47:45.131696 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9981009-e077-4167-928e-1a66ed4cc24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:47:45.132296 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9981009-e077-4167-928e-1a66ed4cc24c service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:47:45.132581 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9981009-e077-4167-928e-1a66ed4cc24c service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:47:45.132856 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9981009-e077-4167-928e-1a66ed4cc24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:47:45.134634 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c9981009-e077-4167-928e-1a66ed4cc24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:47:45.157962 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9981009-e077-4167-928e-1a66ed4cc24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:47:45.159398 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9981009-e077-4167-928e-1a66ed4cc24c service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:47:45.167482 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1462/2921] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:47:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:47:54.855788 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=3 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:47:55.163793 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=15 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:48:02.521341 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5669a-3214-4df2-9453-3cc5e3694f14 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:02.521975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5669a-3214-4df2-9453-3cc5e3694f14 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:02.521975 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5669a-3214-4df2-9453-3cc5e3694f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:02.542740 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-d7c5669a-3214-4df2-9453-3cc5e3694f14 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:48:02.543989 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-d7c5669a-3214-4df2-9453-3cc5e3694f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:02.551847 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1460/2922] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:48:02.572323 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9981009-e077-4167-928e-1a66ed4cc24c service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:02.585987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9981009-e077-4167-928e-1a66ed4cc24c service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:02.591966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53579262-d170-4e60-8302-07f3baf72326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:02.592571 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53579262-d170-4e60-8302-07f3baf72326 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:02.592842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53579262-d170-4e60-8302-07f3baf72326 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:02.593110 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53579262-d170-4e60-8302-07f3baf72326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:02.601659 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53579262-d170-4e60-8302-07f3baf72326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:02.603411 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53579262-d170-4e60-8302-07f3baf72326 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:02.613214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1463/2923] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:48:07.144974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd86533-d9d3-4503-afad-cb18b2ebd1d3 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:07.145883 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd86533-d9d3-4503-afad-cb18b2ebd1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:07.146087 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd86533-d9d3-4503-afad-cb18b2ebd1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:07.166986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-7cd86533-d9d3-4503-afad-cb18b2ebd1d3 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:48:07.168280 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7cd86533-d9d3-4503-afad-cb18b2ebd1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:07.176245 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1461/2924] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:48:07.197569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53579262-d170-4e60-8302-07f3baf72326 service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:07.211804 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53579262-d170-4e60-8302-07f3baf72326 service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:07.217616 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1094f-2fb4-4a9b-babd-6f855593ac60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:07.218262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1094f-2fb4-4a9b-babd-6f855593ac60 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:07.218546 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1094f-2fb4-4a9b-babd-6f855593ac60 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:07.218828 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1094f-2fb4-4a9b-babd-6f855593ac60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:07.227986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1094f-2fb4-4a9b-babd-6f855593ac60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:07.229711 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1094f-2fb4-4a9b-babd-6f855593ac60 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:07.240378 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1464/2925] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:48:11.179716 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f992e-7c26-44f2-bb73-d9b819b126c4 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:11.180334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f992e-7c26-44f2-bb73-d9b819b126c4 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:11.180334 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f992e-7c26-44f2-bb73-d9b819b126c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:11.201315 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b54f992e-7c26-44f2-bb73-d9b819b126c4 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:48:11.202577 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b54f992e-7c26-44f2-bb73-d9b819b126c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:11.210570 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1462/2926] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:48:11.235177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1094f-2fb4-4a9b-babd-6f855593ac60 service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:11.247026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1094f-2fb4-4a9b-babd-6f855593ac60 service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:11.253232 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f69fd2-5bb8-45eb-b3b7-76253b3c45db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:11.253893 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f69fd2-5bb8-45eb-b3b7-76253b3c45db service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:11.254174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f69fd2-5bb8-45eb-b3b7-76253b3c45db service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:11.254449 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f69fd2-5bb8-45eb-b3b7-76253b3c45db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:11.264322 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f69fd2-5bb8-45eb-b3b7-76253b3c45db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:11.265969 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f69fd2-5bb8-45eb-b3b7-76253b3c45db service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:11.276628 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1465/2927] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:48:17.493829 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b91e3-d42b-464c-856f-a983be819a32 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:17.494391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b91e3-d42b-464c-856f-a983be819a32 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:17.494552 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b91e3-d42b-464c-856f-a983be819a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:17.513870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-ee7b91e3-d42b-464c-856f-a983be819a32 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:48:17.515717 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-ee7b91e3-d42b-464c-856f-a983be819a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:17.523667 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1463/2928] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:48:17.550054 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f69fd2-5bb8-45eb-b3b7-76253b3c45db service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:17.561553 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f69fd2-5bb8-45eb-b3b7-76253b3c45db service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:17.567303 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c24e0f-db61-41a0-a89e-1adf90d600b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:17.567902 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24e0f-db61-41a0-a89e-1adf90d600b6 service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:17.568177 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24e0f-db61-41a0-a89e-1adf90d600b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:17.568471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c24e0f-db61-41a0-a89e-1adf90d600b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:17.578135 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24e0f-db61-41a0-a89e-1adf90d600b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:17.579724 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c24e0f-db61-41a0-a89e-1adf90d600b6 service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:17.589878 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1466/2929] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:48:21.752686 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d1cfa-a810-4592-8ba7-703d2d53eac8 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:21.753241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d1cfa-a810-4592-8ba7-703d2d53eac8 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:21.753241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d1cfa-a810-4592-8ba7-703d2d53eac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:21.773708 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-c04d1cfa-a810-4592-8ba7-703d2d53eac8 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:48:21.774904 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c04d1cfa-a810-4592-8ba7-703d2d53eac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:21.782806 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1464/2930] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 31 19:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:48:21.806214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c24e0f-db61-41a0-a89e-1adf90d600b6 service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:21.819668 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c24e0f-db61-41a0-a89e-1adf90d600b6 service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:21.825315 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789d492-a0c9-4779-b344-327ad18bad3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:21.825939 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789d492-a0c9-4779-b344-327ad18bad3f service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:21.826218 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789d492-a0c9-4779-b344-327ad18bad3f service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:21.826492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789d492-a0c9-4779-b344-327ad18bad3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:21.835720 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789d492-a0c9-4779-b344-327ad18bad3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:21.837268 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789d492-a0c9-4779-b344-327ad18bad3f service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:21.847966 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1467/2931] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:48:25.892992 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d1cfa-a810-4592-8ba7-703d2d53eac8 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:25.894397 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c04d1cfa-a810-4592-8ba7-703d2d53eac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:25.898714 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=16 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:48:25.931337 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d1cfa-a810-4592-8ba7-703d2d53eac8 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:25.935110 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91624b1-a2d4-47ca-8a4d-7a76d694927a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c57f22b304dcda6fcaba3fb01d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:25.935680 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91624b1-a2d4-47ca-8a4d-7a76d694927a service cinder] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:25.935957 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91624b1-a2d4-47ca-8a4d-7a76d694927a service cinder] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:25.936229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91624b1-a2d4-47ca-8a4d-7a76d694927a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:25.937951 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c91624b1-a2d4-47ca-8a4d-7a76d694927a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:25.951526 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91624b1-a2d4-47ca-8a4d-7a76d694927a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:25.952941 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91624b1-a2d4-47ca-8a4d-7a76d694927a service cinder] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:25.963973 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1465/2932] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:48:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:48:30.007493 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789d492-a0c9-4779-b344-327ad18bad3f service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:30.011786 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=31 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:48:30.017313 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789d492-a0c9-4779-b344-327ad18bad3f service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:30.021466 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce650cd-b3ed-40df-abfc-459cbcf10359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:30.022441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce650cd-b3ed-40df-abfc-459cbcf10359 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:30.022441 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce650cd-b3ed-40df-abfc-459cbcf10359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:30.022764 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce650cd-b3ed-40df-abfc-459cbcf10359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:30.024402 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-8ce650cd-b3ed-40df-abfc-459cbcf10359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:30.037903 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce650cd-b3ed-40df-abfc-459cbcf10359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:30.039394 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce650cd-b3ed-40df-abfc-459cbcf10359 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:30.051136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1468/2933] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:48:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:48:35.958907 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=14 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:48:40.045887 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=5 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:48:58.163183 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91624b1-a2d4-47ca-8a4d-7a76d694927a service cinder] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:58.175723 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91624b1-a2d4-47ca-8a4d-7a76d694927a service cinder] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:58.183142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:58.183142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:58.183142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:58.183142 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] PATH_INFO: `/v3/users/7e0954ad0ec342ad8c8c312214d24de8` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:58.183704 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0954ad0ec342ad8c8c312214d24de8)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:58.184805 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:58.462376 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0954ad0ec342ad8c8c312214d24de8'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:48:58.529115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0954ad0ec342ad8c8c312214d24de8'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:48:58.529797 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0954ad0ec342ad8c8c312214d24de8'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:48:58.542201 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0954ad0ec342ad8c8c312214d24de8'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:48:58.542856 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-0c2ea7cb-02c5-4cf3-9683-6ec471ca1d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0954ad0ec342ad8c8c312214d24de8'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:48:58.555149 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1466/2934] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:48:58 2022] DELETE /identity/v3/users/7e0954ad0ec342ad8c8c312214d24de8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:48:58.814752 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce650cd-b3ed-40df-abfc-459cbcf10359 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:58.822569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce650cd-b3ed-40df-abfc-459cbcf10359 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:58.882266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:58.882931 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:58.883214 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:58.883492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] PATH_INFO: `/v3/projects/9f6c3996bf2a419e89771639fde12578` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:58.884620 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6c3996bf2a419e89771639fde12578)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:58.887238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:58.997735 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6c3996bf2a419e89771639fde12578', 'request_id': 'req-2e20af0a-40da-4818-9b2d-073964a857fe'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:48:59.003923 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6c3996bf2a419e89771639fde12578', 'request_id': 'req-2e20af0a-40da-4818-9b2d-073964a857fe'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:48:59.088817 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6c3996bf2a419e89771639fde12578', 'request_id': 'req-2e20af0a-40da-4818-9b2d-073964a857fe'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:48:59.100509 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] The token cache is being invalidate because project 9f6c3996bf2a419e89771639fde12578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:48:59.102769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:48:59.102769 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-2e20af0a-40da-4818-9b2d-073964a857fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:48:59.103379 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1469/2935] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:48:58 2022] DELETE /identity/v3/projects/9f6c3996bf2a419e89771639fde12578 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:48:59.108885 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e940db8-86b0-4c9c-b448-4997d7269823 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:59.109232 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e940db8-86b0-4c9c-b448-4997d7269823 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:59.109514 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e940db8-86b0-4c9c-b448-4997d7269823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:59.129801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-7e940db8-86b0-4c9c-b448-4997d7269823 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:48:59.131024 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-7e940db8-86b0-4c9c-b448-4997d7269823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:59.191120 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1467/2936] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:48:59.199097 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98921b9-7e99-4f65-9a0f-69bfee275155 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:59.199387 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98921b9-7e99-4f65-9a0f-69bfee275155 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:59.199666 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98921b9-7e99-4f65-9a0f-69bfee275155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:59.219815 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-f98921b9-7e99-4f65-9a0f-69bfee275155 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:48:59.221032 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-f98921b9-7e99-4f65-9a0f-69bfee275155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:59.228958 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1470/2937] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:48:59.233766 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e940db8-86b0-4c9c-b448-4997d7269823 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:59.243759 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e940db8-86b0-4c9c-b448-4997d7269823 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:59.249588 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59d0f9-97e8-41b1-8459-b133296230ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:59.250221 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d0f9-97e8-41b1-8459-b133296230ea admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:59.250507 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d0f9-97e8-41b1-8459-b133296230ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:59.250785 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d0f9-97e8-41b1-8459-b133296230ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:59.251441 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59d0f9-97e8-41b1-8459-b133296230ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81728) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:48:59.251747 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59d0f9-97e8-41b1-8459-b133296230ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:59.253486 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59d0f9-97e8-41b1-8459-b133296230ea admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:59.265578 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1468/2938] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 31 19:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:48:59.270391 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98921b9-7e99-4f65-9a0f-69bfee275155 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:59.279853 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98921b9-7e99-4f65-9a0f-69bfee275155 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:59.284537 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb99c93-38bc-4345-bb5e-aae7cf804e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:59.285133 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb99c93-38bc-4345-bb5e-aae7cf804e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:59.285406 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb99c93-38bc-4345-bb5e-aae7cf804e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:59.285690 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb99c93-38bc-4345-bb5e-aae7cf804e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:59.286342 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb99c93-38bc-4345-bb5e-aae7cf804e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:59.288457 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb99c93-38bc-4345-bb5e-aae7cf804e89 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:59.380436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1471/2939] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:48:59 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:48:59.384480 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59d0f9-97e8-41b1-8459-b133296230ea admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:59.394551 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59d0f9-97e8-41b1-8459-b133296230ea admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:59.450381 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c9781-28a4-4818-ac39-27732c2b1c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:59.451020 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c9781-28a4-4818-ac39-27732c2b1c67 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:59.451402 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c9781-28a4-4818-ac39-27732c2b1c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:59.451684 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c9781-28a4-4818-ac39-27732c2b1c67 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:59.452369 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c9781-28a4-4818-ac39-27732c2b1c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:59.454273 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c9781-28a4-4818-ac39-27732c2b1c67 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:59.462151 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:48:59.546241 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1469/2940] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:48:59 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:48:59.550629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb99c93-38bc-4345-bb5e-aae7cf804e89 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:59.561039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb99c93-38bc-4345-bb5e-aae7cf804e89 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:59.565738 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600bf28-03d6-4d6e-b9b8-efba703dffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:59.566435 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600bf28-03d6-4d6e-b9b8-efba703dffaf admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:59.566712 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600bf28-03d6-4d6e-b9b8-efba703dffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:59.566986 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600bf28-03d6-4d6e-b9b8-efba703dffaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:59.567626 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600bf28-03d6-4d6e-b9b8-efba703dffaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:59.569204 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600bf28-03d6-4d6e-b9b8-efba703dffaf admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:59.579518 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1472/2941] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:48:59.583303 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c9781-28a4-4818-ac39-27732c2b1c67 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:59.593499 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c9781-28a4-4818-ac39-27732c2b1c67 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:59.598083 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d2c77-d27d-40a4-94fe-6d9ca6eb4915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:59.598673 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d2c77-d27d-40a4-94fe-6d9ca6eb4915 admin admin] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:59.598954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d2c77-d27d-40a4-94fe-6d9ca6eb4915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:59.599230 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d2c77-d27d-40a4-94fe-6d9ca6eb4915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:59.599870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d2c77-d27d-40a4-94fe-6d9ca6eb4915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:59.601489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d2c77-d27d-40a4-94fe-6d9ca6eb4915 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:59.612643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1470/2942] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:48:59.616646 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600bf28-03d6-4d6e-b9b8-efba703dffaf admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:59.627266 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600bf28-03d6-4d6e-b9b8-efba703dffaf admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:59.632034 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07fdc-98ca-4ec4-9089-6574ac92b5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:59.632625 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07fdc-98ca-4ec4-9089-6574ac92b5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:59.632907 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07fdc-98ca-4ec4-9089-6574ac92b5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:59.633183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07fdc-98ca-4ec4-9089-6574ac92b5f9 admin admin] PATH_INFO: `/v3/projects/c20bc4b84b3647bcad8e175af12f2682/users/44cb3859d952495e97753e1c4a10dbf9/roles/d1bf17fdde744527bb5905634f0b1b2c` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:59.647950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e07fdc-98ca-4ec4-9089-6574ac92b5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20bc4b84b3647bcad8e175af12f2682, user_id=44cb3859d952495e97753e1c4a10dbf9, role_id=d1bf17fdde744527bb5905634f0b1b2c)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:59.650627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e07fdc-98ca-4ec4-9089-6574ac92b5f9 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:59.722684 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1473/2943] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:48:59 2022] PUT /identity/v3/projects/c20bc4b84b3647bcad8e175af12f2682/users/44cb3859d952495e97753e1c4a10dbf9/roles/d1bf17fdde744527bb5905634f0b1b2c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:48:59.727743 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987874f-07c4-4a8e-8a4d-1832d7e170c9 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:59.728030 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987874f-07c4-4a8e-8a4d-1832d7e170c9 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:59.728306 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987874f-07c4-4a8e-8a4d-1832d7e170c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:59.748643 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-f987874f-07c4-4a8e-8a4d-1832d7e170c9 None None] MFA Rules not processed for user `59bd1470a00849b4b09de0a61612c525`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:48:59.749884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f987874f-07c4-4a8e-8a4d-1832d7e170c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:59.806781 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1471/2944] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:48:59.816601 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07fdc-98ca-4ec4-9089-6574ac92b5f9 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:48:59.818866 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-a0e07fdc-98ca-4ec4-9089-6574ac92b5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:48:59.839487 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:48:59.876745 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07fdc-98ca-4ec4-9089-6574ac92b5f9 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:48:59.880408 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff7d3f-240c-4b35-adb5-19df1a46fe32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:48:59.881010 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff7d3f-240c-4b35-adb5-19df1a46fe32 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:48:59.881294 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff7d3f-240c-4b35-adb5-19df1a46fe32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:48:59.881569 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff7d3f-240c-4b35-adb5-19df1a46fe32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:48:59.891330 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff7d3f-240c-4b35-adb5-19df1a46fe32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:48:59.892723 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff7d3f-240c-4b35-adb5-19df1a46fe32 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:48:59.902627 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1474/2945] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:49:05.144339 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60200-e934-4182-9611-8a1db67731d1 None None] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:05.144801 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60200-e934-4182-9611-8a1db67731d1 None None] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:05.145224 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60200-e934-4182-9611-8a1db67731d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:05.180147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.auth.core [None req-b3e60200-e934-4182-9611-8a1db67731d1 None None] MFA Rules not processed for user `44cb3859d952495e97753e1c4a10dbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81728) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:49:05.184047 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b3e60200-e934-4182-9611-8a1db67731d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:49:05.253104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1472/2946] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:49:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:49:05.257788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff7d3f-240c-4b35-adb5-19df1a46fe32 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:49:05.281490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff7d3f-240c-4b35-adb5-19df1a46fe32 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:49:05.281490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f670751-ab1b-490e-82c7-c82ab7339e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:49:05.281490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670751-ab1b-490e-82c7-c82ab7339e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:05.281490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670751-ab1b-490e-82c7-c82ab7339e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:05.281976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670751-ab1b-490e-82c7-c82ab7339e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:05.281976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f670751-ab1b-490e-82c7-c82ab7339e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:49:05.281976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f670751-ab1b-490e-82c7-c82ab7339e55 admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:49:05.406079 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1475/2947] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 31 19:49:05 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:49:05.413115 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e60200-e934-4182-9611-8a1db67731d1 None None] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:49:05.421533 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e60200-e934-4182-9611-8a1db67731d1 None None] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:49:05.479971 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9934fcd-1ad8-47de-9051-0f948b97b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:49:05.480587 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934fcd-1ad8-47de-9051-0f948b97b399 admin admin] REQUEST_METHOD: `POST` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:05.480865 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934fcd-1ad8-47de-9051-0f948b97b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:05.481137 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934fcd-1ad8-47de-9051-0f948b97b399 admin admin] PATH_INFO: `/v3/users` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:05.482489 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9934fcd-1ad8-47de-9051-0f948b97b399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:49:05.485103 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9934fcd-1ad8-47de-9051-0f948b97b399 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:49:05.558033 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:49:05.567538 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1473/2948] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 31 19:49:05 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:49:05.568768 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f670751-ab1b-490e-82c7-c82ab7339e55 admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:49:05.579686 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f670751-ab1b-490e-82c7-c82ab7339e55 admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:49:05.584533 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245759b1-b6d7-4c4e-b7d5-ec7ae6d89a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:49:05.585139 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245759b1-b6d7-4c4e-b7d5-ec7ae6d89a9e admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:05.585423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245759b1-b6d7-4c4e-b7d5-ec7ae6d89a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:05.585729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245759b1-b6d7-4c4e-b7d5-ec7ae6d89a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:05.586373 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245759b1-b6d7-4c4e-b7d5-ec7ae6d89a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:49:05.588057 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245759b1-b6d7-4c4e-b7d5-ec7ae6d89a9e admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:49:05.599420 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1476/2949] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:49:05.603813 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9934fcd-1ad8-47de-9051-0f948b97b399 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:49:05.614866 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9934fcd-1ad8-47de-9051-0f948b97b399 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:49:05.619501 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc43fe1-398a-4396-b698-c3ce336bd418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:49:05.620157 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc43fe1-398a-4396-b698-c3ce336bd418 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:05.620440 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc43fe1-398a-4396-b698-c3ce336bd418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:05.620978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc43fe1-398a-4396-b698-c3ce336bd418 admin admin] PATH_INFO: `/v3/projects/c4ee64926693417e9b0bafddcb43913e/users/1281dfedd7ad4d8ea67b3bc8032926a1/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:05.635648 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc43fe1-398a-4396-b698-c3ce336bd418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ee64926693417e9b0bafddcb43913e, user_id=1281dfedd7ad4d8ea67b3bc8032926a1, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:49:05.638326 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc43fe1-398a-4396-b698-c3ce336bd418 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:49:05.739428 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1474/2950] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:49:05 2022] PUT /identity/v3/projects/c4ee64926693417e9b0bafddcb43913e/users/1281dfedd7ad4d8ea67b3bc8032926a1/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:49:05.743594 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245759b1-b6d7-4c4e-b7d5-ec7ae6d89a9e admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:49:05.753936 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245759b1-b6d7-4c4e-b7d5-ec7ae6d89a9e admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:49:05.809722 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8e1e6-4b7d-4525-a221-3ed33be3798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:49:05.810238 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e1e6-4b7d-4525-a221-3ed33be3798c admin admin] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:05.810516 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e1e6-4b7d-4525-a221-3ed33be3798c admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:05.810788 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e1e6-4b7d-4525-a221-3ed33be3798c admin admin] PATH_INFO: `/v3/roles` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:05.811852 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8e1e6-4b7d-4525-a221-3ed33be3798c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:49:05.813446 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8e1e6-4b7d-4525-a221-3ed33be3798c admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:49:05.824293 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1477/2951] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 31 19:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:49:05.829006 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc43fe1-398a-4396-b698-c3ce336bd418 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:49:05.840726 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc43fe1-398a-4396-b698-c3ce336bd418 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:49:05.846210 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a0fd9-de9a-4b87-9cff-42d6cf25d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:49:05.846884 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a0fd9-de9a-4b87-9cff-42d6cf25d434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:05.847171 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a0fd9-de9a-4b87-9cff-42d6cf25d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:05.847454 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a0fd9-de9a-4b87-9cff-42d6cf25d434 admin admin] PATH_INFO: `/v3/projects/c4ee64926693417e9b0bafddcb43913e/users/1281dfedd7ad4d8ea67b3bc8032926a1/roles/d7a6b2a9ee8048d0879546334583d6fd` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:05.849411 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a0fd9-de9a-4b87-9cff-42d6cf25d434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ee64926693417e9b0bafddcb43913e, user_id=1281dfedd7ad4d8ea67b3bc8032926a1, role_id=d7a6b2a9ee8048d0879546334583d6fd)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:49:05.852096 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a0fd9-de9a-4b87-9cff-42d6cf25d434 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:49:05.863333 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1475/2952] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 31 19:49:05 2022] PUT /identity/v3/projects/c4ee64926693417e9b0bafddcb43913e/users/1281dfedd7ad4d8ea67b3bc8032926a1/roles/d7a6b2a9ee8048d0879546334583d6fd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:49:11.460510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03145b8-f1ee-490a-8209-1398befaa9d8 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:11.460994 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03145b8-f1ee-490a-8209-1398befaa9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:11.461094 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03145b8-f1ee-490a-8209-1398befaa9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:11.492018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-c03145b8-f1ee-490a-8209-1398befaa9d8 None None] MFA Rules not processed for user `1281dfedd7ad4d8ea67b3bc8032926a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:49:11.493395 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-c03145b8-f1ee-490a-8209-1398befaa9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:49:11.566715 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1478/2953] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:49:11.583207 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a0fd9-de9a-4b87-9cff-42d6cf25d434 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:49:11.585102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-9f7a0fd9-de9a-4b87-9cff-42d6cf25d434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:49:11.667632 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a0fd9-de9a-4b87-9cff-42d6cf25d434 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:49:11.674419 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b5a70-c838-4988-909b-d10c2bd93247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:49:11.675048 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5a70-c838-4988-909b-d10c2bd93247 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:11.675330 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5a70-c838-4988-909b-d10c2bd93247 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:11.675728 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5a70-c838-4988-909b-d10c2bd93247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:11.734832 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b5a70-c838-4988-909b-d10c2bd93247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:49:11.736757 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b5a70-c838-4988-909b-d10c2bd93247 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:49:11.746985 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1476/2954] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:49:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:49:14.553492 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c62e7b-52fb-4340-bbdb-d209174c0498 None None] REQUEST_METHOD: `POST` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:14.554134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c62e7b-52fb-4340-bbdb-d209174c0498 None None] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:14.554134 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c62e7b-52fb-4340-bbdb-d209174c0498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:14.574136 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.auth.core [None req-e5c62e7b-52fb-4340-bbdb-d209174c0498 None None] MFA Rules not processed for user `44cb3859d952495e97753e1c4a10dbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81727) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:49:14.575412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e5c62e7b-52fb-4340-bbdb-d209174c0498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:49:14.582412 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1479/2955] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 31 19:49:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:49:21.741986 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:49:24.567507 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:49:36.827546 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b5a70-c838-4988-909b-d10c2bd93247 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:49:36.918517 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b5a70-c838-4988-909b-d10c2bd93247 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:49:36.925187 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc2a4d-1760-4610-886f-4dafba4a6c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:49:36.926332 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2a4d-1760-4610-886f-4dafba4a6c64 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:36.926861 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2a4d-1760-4610-886f-4dafba4a6c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:36.927371 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2a4d-1760-4610-886f-4dafba4a6c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:36.930525 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b2bc2a4d-1760-4610-886f-4dafba4a6c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:49:36.948393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc2a4d-1760-4610-886f-4dafba4a6c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:49:36.951147 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc2a4d-1760-4610-886f-4dafba4a6c64 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:49:36.965113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1477/2956] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:49:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:49:46.960158 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=26 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:49:47.835112 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c62e7b-52fb-4340-bbdb-d209174c0498 None None] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:49:47.848821 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c62e7b-52fb-4340-bbdb-d209174c0498 None None] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:49:47.852416 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d243e6-cace-4e41-b5e7-929baed79a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:49:47.853174 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d243e6-cace-4e41-b5e7-929baed79a22 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:49:47.853314 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d243e6-cace-4e41-b5e7-929baed79a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:49:47.853560 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d243e6-cace-4e41-b5e7-929baed79a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:49:47.866056 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d243e6-cace-4e41-b5e7-929baed79a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:49:47.867497 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d243e6-cace-4e41-b5e7-929baed79a22 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:49:47.877950 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1480/2957] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:49:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:49:57.873308 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=6 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:52:27.123540 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc2a4d-1760-4610-886f-4dafba4a6c64 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:52:27.126077 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-b2bc2a4d-1760-4610-886f-4dafba4a6c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:52:27.206079 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc2a4d-1760-4610-886f-4dafba4a6c64 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:52:27.211239 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f1867-87e5-47ca-8967-f11ab00eeaf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:52:27.212767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f1867-87e5-47ca-8967-f11ab00eeaf2 service placement] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:52:27.212767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f1867-87e5-47ca-8967-f11ab00eeaf2 service placement] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:52:27.212767 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f1867-87e5-47ca-8967-f11ab00eeaf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:52:27.214391 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-5a2f1867-87e5-47ca-8967-f11ab00eeaf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:52:27.227229 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f1867-87e5-47ca-8967-f11ab00eeaf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:52:27.228916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f1867-87e5-47ca-8967-f11ab00eeaf2 service placement] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:52:27.241433 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1478/2958] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:52:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:52:28.812629 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d243e6-cace-4e41-b5e7-929baed79a22 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:52:28.826545 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d243e6-cace-4e41-b5e7-929baed79a22 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:52:28.831485 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26830cf1-62e8-419c-9796-c29a862154bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:52:28.832180 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26830cf1-62e8-419c-9796-c29a862154bc service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:52:28.832536 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26830cf1-62e8-419c-9796-c29a862154bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:52:28.832854 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26830cf1-62e8-419c-9796-c29a862154bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:52:28.834755 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-26830cf1-62e8-419c-9796-c29a862154bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:52:28.848568 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26830cf1-62e8-419c-9796-c29a862154bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:52:28.850371 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26830cf1-62e8-419c-9796-c29a862154bc service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:52:28.858830 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1481/2959] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:52:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:52:28.947457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f1867-87e5-47ca-8967-f11ab00eeaf2 service placement] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:52:28.948870 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-5a2f1867-87e5-47ca-8967-f11ab00eeaf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:52:28.960574 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f1867-87e5-47ca-8967-f11ab00eeaf2 service placement] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:52:28.964113 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a89704-84b6-4e86-b935-a124221af6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:52:28.964698 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a89704-84b6-4e86-b935-a124221af6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:52:28.964974 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a89704-84b6-4e86-b935-a124221af6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:52:28.965247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a89704-84b6-4e86-b935-a124221af6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:52:28.966933 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-20a89704-84b6-4e86-b935-a124221af6b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:52:28.981457 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a89704-84b6-4e86-b935-a124221af6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:52:28.982991 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a89704-84b6-4e86-b935-a124221af6b3 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:52:28.993753 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1479/2960] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:52:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:52:29.054761 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26830cf1-62e8-419c-9796-c29a862154bc service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:52:29.066987 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26830cf1-62e8-419c-9796-c29a862154bc service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:52:29.072158 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d631ce-74ce-4d41-b46f-1ef6e7b50839 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:52:29.072929 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d631ce-74ce-4d41-b46f-1ef6e7b50839 service placement] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:52:29.073213 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d631ce-74ce-4d41-b46f-1ef6e7b50839 service placement] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:52:29.073490 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d631ce-74ce-4d41-b46f-1ef6e7b50839 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:52:29.075247 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-47d631ce-74ce-4d41-b46f-1ef6e7b50839 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:52:29.088026 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d631ce-74ce-4d41-b46f-1ef6e7b50839 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:52:29.089595 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d631ce-74ce-4d41-b46f-1ef6e7b50839 service placement] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:52:29.100178 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1482/2961] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:52:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:52:29.382823 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a89704-84b6-4e86-b935-a124221af6b3 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:52:29.384227 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-20a89704-84b6-4e86-b935-a124221af6b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:52:29.398822 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a89704-84b6-4e86-b935-a124221af6b3 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:52:29.404317 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f118335-52fb-4c37-bb21-7f4d2e908a61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:52:29.404914 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f118335-52fb-4c37-bb21-7f4d2e908a61 service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:52:29.405192 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f118335-52fb-4c37-bb21-7f4d2e908a61 service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:52:29.405466 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f118335-52fb-4c37-bb21-7f4d2e908a61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:52:29.407211 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-1f118335-52fb-4c37-bb21-7f4d2e908a61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:52:29.419491 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f118335-52fb-4c37-bb21-7f4d2e908a61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:52:29.421057 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f118335-52fb-4c37-bb21-7f4d2e908a61 service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:52:29.432104 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1480/2962] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:52:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:52:39.095297 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=12 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:52:39.427288 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=44 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:17.875030 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d631ce-74ce-4d41-b46f-1ef6e7b50839 service placement] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:17.884838 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d631ce-74ce-4d41-b46f-1ef6e7b50839 service placement] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:17.888397 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99e4f2-92ec-4a07-a7d9-6a7008fe3b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:17.888990 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99e4f2-92ec-4a07-a7d9-6a7008fe3b1b service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:17.889270 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99e4f2-92ec-4a07-a7d9-6a7008fe3b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:17.889548 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99e4f2-92ec-4a07-a7d9-6a7008fe3b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:17.897843 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99e4f2-92ec-4a07-a7d9-6a7008fe3b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:17.899262 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99e4f2-92ec-4a07-a7d9-6a7008fe3b1b service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:17.908488 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1483/2963] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:54:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:54:18.837947 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f118335-52fb-4c37-bb21-7f4d2e908a61 service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:18.849911 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f118335-52fb-4c37-bb21-7f4d2e908a61 service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:18.855567 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d01269-249b-4c9d-a523-19a86b2ed88f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:18.856700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d01269-249b-4c9d-a523-19a86b2ed88f service nova] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:18.856700 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d01269-249b-4c9d-a523-19a86b2ed88f service nova] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:18.857459 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d01269-249b-4c9d-a523-19a86b2ed88f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:18.859186 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-f1d01269-249b-4c9d-a523-19a86b2ed88f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:54:18.872455 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d01269-249b-4c9d-a523-19a86b2ed88f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:18.875076 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d01269-249b-4c9d-a523-19a86b2ed88f service nova] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:18.886978 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1481/2964] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:54:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:54:19.289269 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99e4f2-92ec-4a07-a7d9-6a7008fe3b1b service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:19.298842 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99e4f2-92ec-4a07-a7d9-6a7008fe3b1b service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:19.302565 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956fca6-4cdd-471c-bbe4-3c4250768d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:19.303141 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956fca6-4cdd-471c-bbe4-3c4250768d30 service neutron] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:19.303421 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956fca6-4cdd-471c-bbe4-3c4250768d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:19.303729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956fca6-4cdd-471c-bbe4-3c4250768d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:19.305824 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-e956fca6-4cdd-471c-bbe4-3c4250768d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:54:19.320017 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956fca6-4cdd-471c-bbe4-3c4250768d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:19.321463 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956fca6-4cdd-471c-bbe4-3c4250768d30 service neutron] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:19.333100 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1484/2965] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:54:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:54:20.521812 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d01269-249b-4c9d-a523-19a86b2ed88f service nova] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:20.531447 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d01269-249b-4c9d-a523-19a86b2ed88f service nova] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:20.535027 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2210c-ac82-4ba9-8729-be6d46614ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:20.535633 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2210c-ac82-4ba9-8729-be6d46614ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:20.535916 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2210c-ac82-4ba9-8729-be6d46614ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:20.536191 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2210c-ac82-4ba9-8729-be6d46614ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:20.537952 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-60c2210c-ac82-4ba9-8729-be6d46614ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:54:20.552999 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2210c-ac82-4ba9-8729-be6d46614ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:20.554463 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2210c-ac82-4ba9-8729-be6d46614ae1 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:20.566798 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1482/2966] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:54:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:54:21.689999 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956fca6-4cdd-471c-bbe4-3c4250768d30 service neutron] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:21.702801 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956fca6-4cdd-471c-bbe4-3c4250768d30 service neutron] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:21.709067 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ce128-3655-46b8-a745-fcd39bdf79ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799cbde43a3643a4beef892d23145112', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:21.709692 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce128-3655-46b8-a745-fcd39bdf79ab service nova] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:21.709910 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce128-3655-46b8-a745-fcd39bdf79ab service nova] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:21.710183 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce128-3655-46b8-a745-fcd39bdf79ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:21.712022 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-eb7ce128-3655-46b8-a745-fcd39bdf79ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:54:21.724813 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ce128-3655-46b8-a745-fcd39bdf79ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:21.726450 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ce128-3655-46b8-a745-fcd39bdf79ab service nova] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:21.737101 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1485/2967] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:54:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:54:24.313254 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2210c-ac82-4ba9-8729-be6d46614ae1 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:24.323095 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2210c-ac82-4ba9-8729-be6d46614ae1 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:24.326755 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bc336-3ef2-4b80-8b1d-48359933d5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b263d1092fc148129020ba73f2b8fbd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:24.327353 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bc336-3ef2-4b80-8b1d-48359933d5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:24.327641 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bc336-3ef2-4b80-8b1d-48359933d5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:24.327954 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bc336-3ef2-4b80-8b1d-48359933d5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:24.389168 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bc336-3ef2-4b80-8b1d-48359933d5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:24.390650 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bc336-3ef2-4b80-8b1d-48359933d5c0 service neutron] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:24.400615 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1483/2968] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:54:28.199018 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ce128-3655-46b8-a745-fcd39bdf79ab service nova] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:28.211274 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ce128-3655-46b8-a745-fcd39bdf79ab service nova] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:28.216252 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7e83-47e8-4203-a1b2-648bc51c59b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:28.216943 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7e83-47e8-4203-a1b2-648bc51c59b0 service placement] REQUEST_METHOD: `GET` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:28.217245 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7e83-47e8-4203-a1b2-648bc51c59b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:28.217593 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7e83-47e8-4203-a1b2-648bc51c59b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:28.219436 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-810d7e83-47e8-4203-a1b2-648bc51c59b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:54:28.231510 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d7e83-47e8-4203-a1b2-648bc51c59b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:28.233164 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d7e83-47e8-4203-a1b2-648bc51c59b0 service placement] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:28.243423 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1486/2969] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:54:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:54:32.055393 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bc336-3ef2-4b80-8b1d-48359933d5c0 service neutron] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:32.073964 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bc336-3ef2-4b80-8b1d-48359933d5c0 service neutron] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:32.079025 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:32.084090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:32.084090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:32.084090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] PATH_INFO: `/v3/users/44cb3859d952495e97753e1c4a10dbf9` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:32.084090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44cb3859d952495e97753e1c4a10dbf9)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:32.084090 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:32.362446 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44cb3859d952495e97753e1c4a10dbf9'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:32.477405 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44cb3859d952495e97753e1c4a10dbf9'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:32.478051 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44cb3859d952495e97753e1c4a10dbf9'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:32.490899 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44cb3859d952495e97753e1c4a10dbf9'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:32.491560 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44cb3859d952495e97753e1c4a10dbf9'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:32.504297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1484/2970] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:54:32 2022] DELETE /identity/v3/users/44cb3859d952495e97753e1c4a10dbf9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:54:32.739039 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7e83-47e8-4203-a1b2-648bc51c59b0 service placement] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:32.752320 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7e83-47e8-4203-a1b2-648bc51c59b0 service placement] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:32.813471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:32.813976 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:32.814339 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:32.814513 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] PATH_INFO: `/v3/projects/c20bc4b84b3647bcad8e175af12f2682` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:32.815666 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20bc4b84b3647bcad8e175af12f2682)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:32.818251 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:32.966000 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20bc4b84b3647bcad8e175af12f2682', 'request_id': 'req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:32.972118 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20bc4b84b3647bcad8e175af12f2682', 'request_id': 'req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.034729 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20bc4b84b3647bcad8e175af12f2682', 'request_id': 'req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.046283 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] The token cache is being invalidate because project c20bc4b84b3647bcad8e175af12f2682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:54:33.046572 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.047202 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.048728 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1487/2971] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:54:32 2022] DELETE /identity/v3/projects/c20bc4b84b3647bcad8e175af12f2682 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:54:33.053744 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:33.055336 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:54:33.069439 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b286418-7d28-4d2d-ae74-23b147c67141 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:33.108247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:33.127733 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:33.128400 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:33.129297 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:33.129604 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] PATH_INFO: `/v3/users/1281dfedd7ad4d8ea67b3bc8032926a1` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:33.130808 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1281dfedd7ad4d8ea67b3bc8032926a1)` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:33.132763 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:33.337389 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1281dfedd7ad4d8ea67b3bc8032926a1'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.428460 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1281dfedd7ad4d8ea67b3bc8032926a1'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.429078 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1281dfedd7ad4d8ea67b3bc8032926a1'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.441247 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1281dfedd7ad4d8ea67b3bc8032926a1'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.441912 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.notifications [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1281dfedd7ad4d8ea67b3bc8032926a1'} {{(pid=81728) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.453795 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1485/2972] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 31 19:54:33 2022] DELETE /identity/v3/users/1281dfedd7ad4d8ea67b3bc8032926a1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:54:33.690471 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] Authenticating user token {{(pid=81727) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:54:33.693265 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.fernet_utils [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81727) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:54:33.705124 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce58b31-1c27-4ff2-9072-83dfe0a8c98f admin admin] Validating token access rules against request {{(pid=81727) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:54:33.743539 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:33.765796 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bd1470a00849b4b09de0a61612c525', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e050b6f9e66f4591994e7fdf0d98777d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81727) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:54:33.766418 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:54:33.766698 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:54:33.766969 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] PATH_INFO: `/v3/projects/c4ee64926693417e9b0bafddcb43913e` {{(pid=81727) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:54:33.768168 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ee64926693417e9b0bafddcb43913e)` {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:54:33.770648 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] RBAC: Authorization granted {{(pid=81727) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:54:33.886944 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ee64926693417e9b0bafddcb43913e', 'request_id': 'req-6820ba01-17eb-426a-96d2-8376631fae1f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.893305 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ee64926693417e9b0bafddcb43913e', 'request_id': 'req-6820ba01-17eb-426a-96d2-8376631fae1f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.971947 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ee64926693417e9b0bafddcb43913e', 'request_id': 'req-6820ba01-17eb-426a-96d2-8376631fae1f'} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.985212 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] The token cache is being invalidate because project c4ee64926693417e9b0bafddcb43913e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81727) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:54:33.989473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.989473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG keystone.notifications [None req-6820ba01-17eb-426a-96d2-8376631fae1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81727) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:54:33.989473 dv-cinder-852209-9-smb devstack@keystone.service[81727]: [pid: 81727|app: 0|req: 1488/2973] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 31 19:54:33 2022] DELETE /identity/v3/projects/c4ee64926693417e9b0bafddcb43913e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:54:43.450377 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:43.981780 dv-cinder-852209-9-smb devstack@keystone.service[81727]: DEBUG dbcounter [-] [81727] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:36.078606 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] Authenticating user token {{(pid=81728) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:57:36.079944 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:57:36.218010 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1ae70-405f-42e0-a63e-15af7c73c607 admin admin] Validating token access rules against request {{(pid=81728) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:57:36.280902 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008b9be-6726-4669-8ead-a3550287f54a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b98cb3da3efe49acbfe640366bf7b53b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3617ea8d0850464ea4d15a7da1d8ce8a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81728) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:57:36.281509 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008b9be-6726-4669-8ead-a3550287f54a service placement] REQUEST_METHOD: `GET` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:57:36.281828 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008b9be-6726-4669-8ead-a3550287f54a service placement] SCRIPT_NAME: `/identity` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:57:36.282102 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008b9be-6726-4669-8ead-a3550287f54a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81728) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:57:36.283873 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.fernet_utils [None req-6008b9be-6726-4669-8ead-a3550287f54a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81728) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:57:36.295296 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008b9be-6726-4669-8ead-a3550287f54a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:57:36.297382 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008b9be-6726-4669-8ead-a3550287f54a service placement] RBAC: Authorization granted {{(pid=81728) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:57:36.308318 dv-cinder-852209-9-smb devstack@keystone.service[81728]: [pid: 81728|app: 0|req: 1486/2974] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 31 19:57:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:57:46.303413 dv-cinder-852209-9-smb devstack@keystone.service[81728]: DEBUG dbcounter [-] [81728] Writing DB stats keystone:SELECT=89 {{(pid=81728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}